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Preface 



The first National Forum on Issues in Vocational Assessment was held 
at the Sheraton Atlanta on September 20-22, 1984. This forum brought together 
nearly two hundred professionals involved in the practice of vocational 
evaluation from a variety of settings. 

The need for a national forum of this type emerged from the growth 
of concern over vocational assessment issues in public schools, social security 
di sabi 1 i ty determi nat i on , vocati onal education , private rehabil i tat ion , 
school psychology, and general state agency rehabilitation programs. Profes- 
sionals in different settings and disciplines have realized the necessity 
for comprehensive vocational assessment services. As these divergent disciplines 
converged in planning and delivering vocational assessment services, the 
need for better communication and for a forum for 'the exchange of information 
was realized. 

Not only did this forum provide the setting for this exchange to begin 
occurring, it also quite dramatically raised the awareness level for the 
need for this interchange to continue with those in attendance. Each discipline 
had i nformati on to share , that , although somewhat uni que to an i ndi vi dual 
discipline, could be applied and adapted to other settings. 

As the profession of vocational evaluation continues to develop, so 
does the need for national information, exchange opportunities such as this 
forum. The professional organizations that coalesced to sponsor this forum 
are challenged to continue this initial effort and bring about future forums. 



Gary Sigmon 

Past President, VEWAA 



ERLC 



vi 

10 



INTRODUCTION 

Previous to the 1980's, the use 
of vocational evaluation services 
with disabled and disadvantaged populations 
had been predomi nantl y conducted i n 
facilities which served public rehabili- 
tation populations. At the turn of 
the decade however, it was apparent 
that those services were migrating 
rapidly to new vocational education 
special needs students, and to the 
pr i vate- for- prof i t rehabil i tat ion 
sector. This growth led to the developing 
Commission on Certification of Work 
Adjustment and Vocational Evaluation 
Specialists' Chairman Paul Myers to 
reflect that the future of certification 
for vocational evaluators was in the 
education setting as the potential 
for certifiable evaluators was four 
plus times greater than in rehabil itation. 

At the same time, the Vocational 
Evaluation and Work Adjustment Association 
(VEWAA), the professional organization 
which had traditionally represented 
vocational evaluators, was receiving 
innumerable request to allow potential 
members to join without joining the 
parent National Rehabilitation Associ- 
ation. These requests were from evaluators 
working in other than rehabilitation 
settings who wanted representation 
in their specialty without joining 
a larger organization to which they 
felt no allegiance. Those evaluators 
desired interaction and representation 
for their professional role. Apart 
from requesting a waiver of NRA dues 
to join VEWAA, those evaluators were 
de vel opi ng their own organi zations 
or requesting increased time on programs 
in their current organizations to 
discuss issues, techniques, and models 
of vocational assessment. Those requests 
of VEWAA and the growth of organizations 
interested in vocational assessment 
led then VEWAA President Walt Pruitt 
to create a VEWAA Interface committee: 

1) vocational evaluators in other 
than rehabilitation settings were 
experienci ng the same problems that 
had plagued rehabilitation evaluators; 

2) vocational evaluators in school 



settings were developing a strong 
animosity toward rehabilitation evaluators 
because they felt rehabilitation 
evaluators presented a smug know-it-all 
image and that VEWAA was not interested 
in them; 3) whatever setting evaluators 
worked in, they were starting a separate 
organization to represent them or 
changing the nature of their traditional 
organization; and 4) due to a shift 
in the job market, a significant 
number of rehabil itation counselor 
new graduates were taking positions 
as vocational evaluators and feeling 
the professional role conflict of 
not knowing which professional organi- 
zation to belong, i.e. VEWAA or the 
National Rehabil itation Counsel ing 
Association (NRCA). 

These factors led to the recognition 
that evaluators from all work settings 
and di f ferent trai ni ng backgrounds 
needed to be brought together in 
a forum to discuss and debate issues 
and developments in vocational assess- 
ment. The VEWAA Interface committee 
took on this chal 1 enge and proposed 
a National Forum to be co-sponsored 
by all i n teres ted organizations. 
Those organizations invited to be 
co-sponsors with the VEWAA included: 
the Ameri can Occupational Therapy 
Association (AOTA); the Division 
of Career Development (DCD), a Division 
of the Council of Exceptional Children; 
the National Association of Rehabili- 
tation Professional s in the Pri vate 
Sector (NARPPS); the National Association 
of School Psychologists (NASP); the 
National Association of Vocational 
Educators of Special Needs Persons 
(NAVESNP), a division of the American 
Vocational Association; and, the 
National Rehabil itation Counsel ing 
Association (NRCA), a division of 
the National Rehabil itation Association. 
Al 1 but the Ameri can Occupa ti onal 
Therapy Association expressed their 
wi 1 1 i ngness to parti ci pate in this 
forum and assi gried a member to work 
with the VEWAA group to make it occur. 

To i denti fy the major issues 
:o be discussed, committee member 
Barbara Greenstein from New York 
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City took on the tasks of defining 
issues from the literature and surveying 
20% of the VEWAA membership for agreement 
on those. Similarly, committee member 
Darrell Coffey of Menomonie, Wisconsin 
agreed to pol 1 the 1 eadershi p of the 
co-sponsoring organizations for their 
agreement on major issues. The result 
of these efforts pointed to a marked 
agreement on six major specific issues 
and a general agreement on a number 
of others. In designing the Forum, 
the committee settled on a structure 
which would examine the current state- 
of-the-art in assessment and would 
facilitate ma x imum i nvol vement of 
all participants. To accomplish this 
and gi ve con si derati on to all the 
identified significant topics, the 
committee decided to invite speakers 
on the issues which received major 
attention in the surveys and to open 
the other topics for participant presen- 
tations. Therefore, the original 
six issues for invited speakers were 
as follows: 1) A Career Development 
Approach to Vocational Evaluation; 

2) Marketing Vocational Evaluation; 

3) Vocational Evaluators as Expert 
Witnesses; 4) Research Needs and Evaluation 
Assessment as a Science; 5) Marketing 
Vocational Evaluation Systems Before 
Adequate Testing and Validation; and 
6) Vocational Assessment Theories, 
Models, and Applications. To those 
six major issues, a seventh was added 
by the VEWAA Board and that was "Certi- 
fication for Teachers and Vocational 
Evaluation Specialists. 11 The committee 
identified the best thinkers known 
on these topics and approached them 
to present and received a 100% positive 
response. 

The other i denti f ied i nterest 
areas clustered around eight board 
areas which were: vocational assessment 
of special populations; innovative 
techniques in vocational evaluation; 
computers in vocational assessment; 
training of vocational assessment 
personnel; physical capacities evaluation; 

^rent process and futurism in vocational 
evaluation; burnout in vocational 
assessment; and research findings 



in vocational assessment . Papers 
were called for in each organization's 
literature and were ably reviewed 
by Robert Davis of Indianapolis, 
Steve Thomas of North Carolina, Pat 
Sitlington of Indiana, and Dennis 
Maki of Iowa. The result of those 
invited and submitted papers are 
presented in this document which 
has been so wel 1 prepared by Ron 
Fry and his staff at the Material s 
Development Center. 

The Forum itsel f drew approximately 
200 individuals, presentors and exhib- 
itors i n teres ted primari ly in one 
subject, vocational evaluation. 
There was an excitement present on 
1 ocation which is difficult to communicate 
here; however it was observed that 
this was one of those few times at 
a meeting in which taking notes was 
a standard procedure and where afternoon 
sessi ons were standi ng room only . 
Coming away from this Forum, it was 
obvious that vocational Eval uation 
has grown up as a profession since 
the last look st the state-of-the-art 
ten years ago. Evaluators are question- 
ing, researching, and developing 
their process and techni ques and 
are in the process of coming of age. 
It was an awesome experience to witness. 

Making thi s program and this 
publication a reality involved a 
number of individuals and organizations. 
While the work was done by the indivi- 
dual s , organizations gave thei r ful 1 
support and encouragement and are 
commended for the spirit of cooperation 
which was shown. Particular credit 
for this has to go to Gary Sigmon 
who risked a sizable portion of the 
VEWAA 1984 budge c to underwrite any 
losses and to the 1984 VEWAA Board 
who went along with Gary although 
it did not appear to be a financially 
wi se decision at the time. Lastly, 
the primary workers on the organizing 
Interfaces committee need a special 
thanks for all their efforts resulting 
in this event. They were: Victoria 
Mason, Cindy Ellis, Linda Ley-Seimer, 
Larry Ornberg, Gary Sigmon, Rock 
Wel don, Michael Peterson, Lee Reynolds, 
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Thomas Hohenshil, John Banks, Hike 
Wada, Robert Davis, Genie Bodenhamer, 
Carol Wagner, Paul Hoffman, Barbara 
Hudson, Barbara Greenstein, Darrell 
Coffey, Hyra Small, Denese Murray, 
Jeani Welsh, Sondra HcDaniel , Susan 
Scott, and Karen Pel 1 . 



Randall S. McDaniel 
Conference Coordinator 
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VOCATIONAL EVALUATION: AN EXPERIMENTAL 
TREND IN VOCATIONAL ASSE 5SMENT 



JULIAN H. NADOLSKY 



ABSTRACT: The development of a concept 
often takes years, decades, or even 
generations before the practical appli- 
cation of that concept is fully recognized, 
accepted, and rendered operational. 
Furthermore, as a concept develops, 
several noteworthy, but isolated, 
attempts may be made to apply that 
concept in different settings prior 
to its acceptance and widespread appli- 
cation. Such was the case with the 
development of the concept that underl ies 
the experiential, work-related approach 
to vocational assessment, which has 
become known as vocational evaluation. 



Hugo Munsterberg is credited 
with initiating the experiential 
approach to vocational assessment 
in the early 1900's. In commenting 
on Munsterberg's concept of vocational 
assessment, Moskowitz (1977) related 
that: 

According to Munsterberg, there 
were two basic methods for the 
investigation of job requirements 
and the development of appropriate 
aptitude tests. The first method 
involves the analysis of the 
tas k into i ts psychol ogical 
components and the creation 
of separate tests to assess 
each component. But this type 
of analysis is i na ppro pr i ate 
or meaningless in many instances, 
and the appropriate method for 
those cases is to develop, in 
the laboratory, a n task-in-mi mature" 
that combines the major elements 
of the job and then to assess 
the applicant's total performance 
on the task (p. 835). 
Munsterberg applied the concept of 
work-related experiences in vocational 
assessment when he developed a miniature 
simulated task or laboratory game 
to select trolly car motormen for 
the Electric Railway Service of Boston. 

In subsequent years , other i sol ated 
experieti ;ial tasks were developed 
for use in different settings to 
determine whether individuals displayed 
the type of talent or skill essential 
to the performance of specific industrial 
jobs, professional activities, military 
duties, and creative work. For example, 
Treat (1929) reported that the I.R.E. 
Trimming Test, a practical task that 
involved the use of scissors to cut 
between a pa i r of narrowi ng 1 i nes , 
correlated .69 with ratings of power- 
sewing machine trainees. The relationship 
between scores on a Metal Filing 
Work Sample, a practical task designed 
to measure one type of skill applied 
in dentistry, and grades in dentistry 
courses was described by Bellows 
(1940). According to Cronbach (1960), 
several tests that employed simulated 
experiential tasks (i.e., the Complex 
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Coordination Test, the Rotary Pursuit 
Test, the Two-Hand Coordination Test, 
the Pursuit Confusion Test, and the 
Rudder Control Test) were developed 
and used by Air Force psychologists 
to assist in the selection of pilots 
during World War II. In addition, 
a few applied tests of artistic creative 
ability, which involved drawing specific 
objects i n perspective and foil owing 
cue lines to independently create 
a freehand s ketch , were de vel oped 
during the 1930' s. The majority of 
these early experiential work-rel a ted 
tasks or applied tests were developed 
for use in speci f i c setti ngs ; most 
of them were not publ ished and , therefore , 
had limited application. 

Since the mid-1950's, several 
applied tests, which involve the appli- 
cation of knowledge or skill required 
in specific occupations or areas of 
work, have been developed and are 
currently available from various test 
publishers. These instruments include 
tests of computer programming, computer 
operating, musical talent, artistic 
ability, typing skill, and related 
occupational knowledge or skill. 
Many of these applied tests are of 
pencil -and-paper variety and do not 
require the use of tools, equipment, 
or material s that are commonly encountered 
in the occupations under consideration. 
Furthermore, these applied tests have 
not been extensively or systematically 
employed to select appl icants or candidates 
for occupations or training programs 
that exist within industrial firms, 
business establ ishments, governmental 
agencies, the military services, or 
educational institutions. Nor have 
they become an integral component 
of traditional vocational assessment 
programs. 

Rather, vocational assessment 
programs have traditional ly pi ace d 
emphasis on the use of tests to assess 
the degree to which individuals possess 
different levels or types of abstract 
traits or characteristics that are 
assumed to be predictive of vocational 
success . These programs rely heavily 
on tests of general intelligence, 



aptitude, achievement, interest, 
and personality to measure individual 
ca paci ties . Once obtained , these 
measures are then related (either 
formally or informally) to the worker 
capacity requirements of various 
occupations . 

This abstract exercise in logic 3 
which provides the basis for the 
tradi ti onal approach to vocational 
as sessment , was deri ved from Al f red 
Binet' s concern with the measurement 
of 11 i ndi vi dual di f f erences 11 among 
school-age children in the early 
1900 1 s . Due to its expedient and 
economical nature, this approach 
has not only persisted, but has become 
the most prevalent method of vocational 
assessment in our society. Thus, 
tests are currently used in most 
vocational assessment programs to 
measure isolated traits that individuals 
possess, a concept that Munsterberg 
felt was inappropriate or meaningless. 

Although the concept underlying 
the use of work-rel ated experiences 
in personnel selection was first 
developed and applied in the early 
1900's, to date, that concept has 
fail ed to gain widespread acceptance 
within the mainstream of the vocational 
assessment movement. But during 
the past 25 years, increasing emphasis 
has been placed on the systematic 
use of wor k-rel ated experiences to 
determi ne the vocati onal potential 
of individuals who have special needs 
and are handicapped for employment. 
An experiential trend i n vocational 
assessment , whi ch appears to ha ve 
had a lasting effect on the vocational 
assessment movement , was i ni tiated 
by the Institute for the Crippled 
and Disabled when it published the 
"TOWER" (Testing, Orientation, and 
Work Eval uation in Rehabil i tation) 
System in 1957. Within a decade 
after the publication of the "TOWER" 
System, a new discipline emerged 
as an experiential extension of the 
vocational assessment movement. 
This di sci pi ine , known as vocational 
evaluation, relies heavily on the 
systematic application of practical 
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work experiences to assess vocational 
potential. Thus, after several decades 
and many isolated attempts at applying 
work-related experiences to vocational 
assessment, the concept proposed by 
Munsterberg has not only been recognized, 
accepted, and rendered operational, 
but has also provided the basis for 
the creation of a new discipline. 

The Nature of Vocational Evaluation 

Vocational evaluation may be 
defined as a process that is designed 
to assess and predict the work behavior 
and vocational potential of individuals 
who are handicapped for employment, 
primarily as a resul t of physical , 
mental, or emotional impairments. 
This definition implies that there 
is a need for two distinct types of 
technology in vocational evaluation. 
One type of technology is needed to 
assess the capacities of individuals 
and to diagnose their vocational assets 
and limitations. Another type of 
technology is needed to predict the 
ca pabil i ties that indi vidua 1 s wil 1 
exhibit at work and to render prognoses 
that accurately reflect those occupational 
areas in which each individual will 
most likely become involved and achieve 
success. Both types of technology 
must be applied in a comprehensive 
program of vocational evaluation, 
and the technology selected for use 
in vocational evaluation should relate 
directly to the capacity requirements 
and capability demands of occupations. 

Due to the comprehensive nature 
of this relatively young discipline, 
the process of vocational evaluation 
is not well understood, either by 
the general public or by many individuals 
who provide vocational evaluation 
services on a daily basis. Much of 
the confusion that exists is a direct 
result of the i nterrel atedness and 
i nterdependency of those concepts 
which are of central importance to 
the vocational evaluation process. 
The concepts capacity and capability, 
much like diagnosis and prognosis, 
are closely related to, and dependent 



upon, one another. These terms are 
often viewed as interchangeable and 
used to represent or descri be the 
same concepts. Consequently, to 
understand the comprehensive nature 
of the vocational evaluation process, 
it is necessary to clarify and differ- 
entiate between the concepts of capacity 
and ca pabil i ty and to distinguish 
diagnosis from prognosis . 

Capacity vs. Capability 

A ca pac i ty may be defined as 
an i n he rent attri bute of a body, 
system, or device which enables it 
to recei ve or accommodate and store 
or hold a particular measure of content. 
Numerical units (i .e. , pounds, cubic 
feet, gallons, and related quantities) 
are often used to designate capacities 
since the ability of a particular 
item to receive or accommodate and 
store or hold is limited by the inherent 
qualities of its structure. In other 
words, the capacity of an item is 
determined by its volume or by the 
amount that it is able to conta i n . 
For this reason, capacities can be 
objectively measured. 

On the other hand, a capability 
may be defined as a feature of a 
body, system, or device that is responsive 
to action, influence, or development. 
Capabi 1 i ti es are not i nherent , nor 
are they determined or limited by 
the structure of an item. Rather, 
the capability of a particular item 
is dependent upon the action or influence 
exerted by or on that i tern as it 
is appl ied in different situations. 
For this reason, capabi 1 ities cannot 
be objecti vel y measured ; they are 
extremely vari abl e and subjecti vely 
derived. 

The capacity f an item can 
be understood by recusing on the 
amount or volume that it can accommodate 
or hold, while an item's capability 
can only be determined by attending 
to what it is able to do or how it 
might be used. For example, the 
capacity of a wastebasket can be 
objecti vely determined by measuri ng 
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the amount or volume that it can hold. 
But a wastebasket has varying types 
of capability which enable it to be 
effectively used for different purposes. 
In addition to being capable of holding 
paper, water, sand, or some other 
material , a wastebasket can also be 
used as a drum, seat, foot stool, 
step, planter, ash tray, or to fulfill 
a variety of other purposes. The 
specific manner in which a wastebasket 
is used will be subjectively dependent 
upon the action or influence exerted 
on it by others. 

However, the capability of a 
wastebasket is, to a great extent, 
determined by its capacity. That 
is, a one- foot high wastebasket with 
a two gallon capacity might be capable 
of serving as an effective foot stool, 
step, drum, or planter, but that same 
wastebasket does not possess sufficient 
capacity to render it capable of serving 
as a comfortable seat. For this reason, 
the capacity of a body, system, or 
device imposes limitations on its 
effective capability but, within these 
1 imitations , a wide variety of capabilities 
exist for any gwen item. 

The terms capacity and capability 
are applied in vocational evaluation 
to respectively designate the traits 
that are required of workers and the 
tasks that workers must perform to 
function in various occupations. 
Worker traits are considered capacities 
since they are inherent characteristics 
possessed by individuals and assumed 
to be normally distributed among the 
general population. Furthermore, 
occupations required different types 
and/or amounts of worker traits, and 
the degree to which individuals possess 
these traits can be objectively measured 
with reasonable accuracy. 

On the other hand, the tasks 
that must be performed constitute 
the worker capability requirements 
of occupations since the ability to 
perform these tasks is dependent upon 
the actions expressed by individuals 
as they use the tools, equipment, 
and materials that are commonly encoun- 
tered in specific work situations. 
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When confronted with new and different 
work situations, individuals rely 
on their background and experience 
to perform the required tasks. They 
do not attack work-related problems 
in a standardized manner, but respond 
to the situation in their own personal 
way. For this reason, the capabilities 
of potential workers cannot be objectively 
measured; they can only be determined 
by focusi ng on the manner in which 
individuals subjec+i vely relate to 
a variety of real or simulated work 
situations . 

As appl ied in vocational evaluation, 
wor ker ca paci ti es represent those 
abstract attributes possessed by 
i ndi vi dual s whi ch can be ob jecti vely 
measured , whi 1 e worker capabil i ties 
relate to those concrete actions 
or behaviors expressed by individuals 
as they sub jecti vel y res pond to a 
given situation. A variety of psycho- 
metric i nstruments are used during 
the initial phase of vocational evaluation 
to objectively measure the traits 
possessed by individuals in relation 
to the worker capacity requirements 
of occupations . Worker capabil i ties 
are determined by observing an individ- 
ual 1 s behavior and performance on 
work samples, si tuational tasks , 
simulated work experiences , occupational 
ex pi oration procedures, and/or job 
tryouts during the experiential phase 
of the vocational evaluation process. 

Diagnosis vs. Prognosis 

Historically, the terms diagnosis 
and prognosis have gained widespread 
use and acceptance within the medical 
profession. In medical terms , diagnosis 
refers to the art or act of identifying 
a disease from its signs or symptoms. 
A diagnosis is essential ly a concise 
statement or conclusion concerning 
the nature or cause of a parti cul ar 
condition as derived from its underlying 
signs or symptoms. Prognosis refers 
to the prospect of recovery from 
a given condition as anticipated 
from the usual course of the disease 
and peculiarities of the case. It 
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is a forecast or prediction about 
what the individual can anticipate 
in the future. 

Conceptually, a diagnosis is 
firmly based upon accumulated knowledge 
that is commonly understood and shared 
by members of a particular discipline. 
It is a categorica l approach to under- 
standing and deaTi ng with problems 
which assumes that conditions which 
affect i ndi vidual s can be understood 
and categorized according to a number 
of common si gns or symptoms . Duri ng 
the diagnostic process, the individual 
is ignored and attention is focused 
on the signs cr symptoms that are 
demonstrated and observed. The process 
of diagnosis gives primary consideration 
to uncovering information that is 
i nternal to the discipline and that 
can only be understood by individuals 
trained in that discipline. The patient 
or client does not have the background 
necessary to understand this information 
or to relate it to a diagnostic category, 

On the other hand, a prognosis 
is conceptually based upon the specific 
characteristics of each individual 
case. Every prognosis, regardless 
of related diagnostic category, will 
be different since they must each 
be based upon the individual and his 
or her particular situation more so 
than upon diagnostic signs or symptoms. 
Factors that are external to ths discipline 
must be taken into consideration when 
rendering a prognosis since ;hey will 
have a marked effect on the accuracy 
of the prognosis. 

Although vocational prognosis 
i s not a new concept it is not wel 1 
understood. Historically, vocational 
assessment programs have been rendering 
vocational prognoses solely on the 
basis of diagnostic findings (i.e., 
bi o graph i cal i nf ormati on , i nte iaw 
data, and psychometric test results). 
These pro grams have been i n vol ved 
in a process of categorizing people 
and rendering predictions or prognoses 
on the basis of categorical data. 
In many instances, they have ignored 
the individual and his or her unique 
situation and have based vocational 



predictions on categories of people 
such as the deaf are good printers, 
the mentally retarded are best suited 
for service work, highly intel 1 igent 
individuals should pursue a professional 
career^ or clerical work is for females. 

Vocational Evaluation 
in the Vocational Assessment Process 

The di sci pi ine of vocational 
evaluation is a definite part of 
the vocational assessment movement 
since it util izes traditional vocational 
assessment techniques and procedures 
to diagnose worker capacities. However, 
real istic work experiences are extensively 
em pi oyed in vocati onal eval uati on 
to determine worker capabilities. 
In fact, the reliance on work- related 
experiences is a central and unique 
feature of vocati onal eval uati on 
whi ch provi des an i denti ty to the 
di sci pi ine and "sets it apart" from 
other programs of vocational assessment. 

Due to i ts di rect concern wi th 
both diagnosis and prognosis, as 
well as its emphasis on the assessment 
of worker capacities and the determination 
of worker capabil ities , vocational 
eval uati on has emerged as a comprehensive 
approach to vocati onal assessment. 
The Tenth Institute on Rehabilitation 
Services (1972) defined vocational 
evaluation as: 

....a comprehensive process 
that systematically utilizes 
work, real or simulated, as 
the focal poi nt for assessment 
and vocati onal exploration, 
the purpose of which is to assist 
individuals in vocational develop- 
ment. Vocational (work) evaluation 
incorporates medical > psychological , 
social , vocational , educational , 
cultural , and economic data 
in the attainment of the goals 
of the evaluation process (p. 2). 
The second sentence in this 
def i ni ti on impl i es that vocational 
eval uati on is not a free standing 
or compl etely autonomous di sci pi i ne* 
Rather, it is a discipline that relies 
on data provided by other professionals 
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to assist in the accurate and economical 
attainment of its goals. In other 
words 9 vocational evaluation incorporates 
data that was previously obtained 
by other disciplines into its process, 
instead of requiring a completely 
new evaluation of an individual's 
status in those areas that might directly 
affect the outcome cf the vocational 
evaluation process. 

In a similar manner, the discipline 
of vocational evaluation incorporates 
previously obtained and relevant vocational 
assessment data i nto the eval uation 
process, rather than using the same 
or similar instruments of vocational 
assessment to recollect that data. 
Thus, vocational evaluation may be 
viewed as the third level of a continuous 
or sequential vocational assessment 
process. Task Force Number One of 
the Vocational Evaluation Project 
(1975) indicated that the vocational 
assessment process consists of three 
levels; namely, (a) First Level of 
Assessment: Screening, (b) Second 
Level of Assessment: Clinical, and 
(c) Third Level of Assessment: Vocational 
Evaluation. In discussing the delivery 
of vocational assessment services, 
Task Force Number One (1975) related 
that: 

....all clients within a service 
program go through a basic assessment 
process, which can be termed 
" screening ." Typically, it is 
similar to the guidance procedures 
used by high school counselors 
or rehabilitation counselors 
in one or two interviews. Extensive 
reliance is placed on client 
statements of choice, competence, 
and job history. It may be supple- 
mented with additional routine 
information available in a program, 
such as normed aptitude tests 
and medical examinations. 

The second level of assessment 
can be termed the cl inical » case 
study, or in-depth vocational 
counsel i ng approach . In addi ti on 
to the methods used in screening, 
the clinical method uses detailed 
re co very of personal hi story , 
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securing and synthesizi ng the 
f i ndi ngs cf other agencies and 
professional persons, use of 
clinically interpreted tests, 
and several hours of interaction 
between counselor and client. 

Vocational evaluation i s 
at the third level of assessment 
in a sequential strategy. This 
assessment process involves 
pi acing the cl ient into real 
or simulated work experience 
within a controlled setting. 
It typical ly in vol ves several 
days of observation and the 
interpretati on of these obser- 
vations . 

The three level sequential 
assessment process has a number 
of advantages to it. First 
it is comprehensi ve : all of 
the clients within a particular 
service program can be accommodated 
within the process. Second, 
the strategy is parsimonious , 
or economi cally conservative: 
the first procedure used is 
the most simple, common , and 
economical; more elaborate, 
difficul t , and expensive assessment 
processes are Used only if neces- 
sary. Third, the strategy is 
direct : as soon as a reasonable 
course of action becomes apparent 
it is effected at once, instead 
of being subjected to a more 
elaborate assessment. Fourth, 
the strategy practices conservation : 
the assessment findings of the 
previous assessment processes 
are retrieved and passed al ong, 
rather than recreating this 
information at each new level 
of assessment. Fifth , the strategy 

is cost-ef fecti ve (pp. 30, 

32). 

Thus , by its very nature, vocational 
evaluation is a comprehensive process. 
It not only makes use of data obtained 
from other disciplines, but also 
systematically applies its own series 
of realistic work experiences with 
each individual served. Vocational 
eval uation is the t hi rd 1 evel of 
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a sequential vocational assessment 
process, designed for individuals 
who require exposure to the realistic 
and experiential demands of specific 
areas of work in order to determine 
their vocational potential. 

The Expansion of Vocational 
Evaluation Services 

Vocational evaluation is a service 
that developed and evolved within 
the context of the vocational rehabili- 
tation movement in an attempt to accurately 
assess the work behavior and vocational 
potential of handicapped individuals. 
Neff (1968) traced the evolution of 
vocational evaluation and indicated 
that vocational evaluation services 
are a logical extension or outgrowth 
of the mental testing approach to 
vocational assessment. Neff further 
suggested that vocational evaluation 
services were designed particularly 
for a handicapped population, a population 
whose work behavior and vocational 
potential could not be adequately 
assessed or effectively determined 
through the use of traditional mental 
or psychological testing procedures. 
Consequently, the field of vocational 
evaluation owes its existence to the 
vocational re ha bi 1 i tati on movement 
and many vocational evaluators remain 
directly involved with programs that 
are primarily designed to serve clients 
of the state/federal vocational rehabili- 
tation system. 

But due to the experiential nature 
of its work-related technology and 
its emphasis on sel f- i nvol vement in 
vocational decision-maki ng , vocational 
evaluation services have been incorporated 
into the structure of various social 
agencies and institutions during the 
past decade. In addition to being 
a service offered by rehabilitation 
facilities, vocational evaluation 
is currently found in public schools, 
vocational-technical schools, community 
colleges, hospitals, mental health 
centers, manpower programs, and in 
a variety of private business or profes- 
sional settings. Although most of 
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our adult population could derive 
personal benefit from parti ci pa ting 
in a vocational evaluation program, 
these programs have become essential 
to the accurate vocational assessment 
of those individuals who are non-verbal ly 
and experiential ly oriented, intuitive 
thinkers. In other words, vocational 
evaluation programs are not onl y 
beneficial, but also essential to 
the career planning and subsequent 
vocational devel opment of i ndi vidual s 
whose thought process is primarily 
governed by the right cerebral hemis- 
phere. Such individuals have special 
needs in our modern soci ety si nee 
they derive minimal benefit from 
exposure to the verbally-oriented 
programs and procedures that have 
been tradi ti onal 1 y and extensively 
appl ied in our service-oriented agencies 
and institutions. 

The majority of individuals 
who receive vo cat i onal assessment 
services from various social agencies 
and institutions do not require vocational 
evaluation; th • have sufficient 
verbal and 1 ogic reasoni ng abil ity 
to benefit from the application of 
traditional verbally-oriented procedures 
empl oyed duri ng the first and second 
levels of the vocational assessment 
process. However, within any service 
population there exists a group of 
individuals whose special needs do 
not permi t them to receive optimum 
be nef i t from their parti ci pati on 
in a traditional program of vocational 
assessment. These individuals are 
predomi nantl y nonverbal ly oriented , 
i ntui ti v<? thi nkers and re qui re an 
ex peri enti al program of vocational 
assessment to effectively determine 
thei r vocational potential . Al though 
it is impossible to specify the exact 
number of individuals who have special 
needs and require vocational evaluation 
services, Task Force Number One of 
the Vocational Evaluation Project 
(1975) indicated that: 

There are no accurate fi gures 
on the sizes of the special 
needs groups. However , there 
are some studies done in different 
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manpower service programs (primarily 
education, labor, and rehabilitation) 
which have estimated the proportion 
of clients from a target population 
who fall into a special needs 
group . These estimates ran je 
from 10% to 20%, but cluster 
around 15% (p. 18). 
Based on these estimates, approxi- 
mately 15% of the population served 
by any agency or insti tuti on that 
is concerned with the career preparation 
or vocational development of its cl ientele 
will require vocational evaluation 
services. And since public schools, 
vocational-technical schools, community 
colleges, manpower agencies, mental 
health centers, and related community 
facilities are directly concerned 
with career preparation or vocational 
development, an increasing number 
of these agencies or institutions 
have incorporated vocational evaluation 
services into their structure during 
the past decade. 

Thus , vocati onal eval uation can 
no 1 onger be accurately i denti f ied 
as a service that is designed primarily 
for cl ients of the state/federal vocational 
rehabilitation program. During the 
past decade, the discipline of vocational 
evaluation has expanded, beyond the 
confines of the vocational rehabil i tat ion 
movement and has become an integral 
component of the service structure 
of many other human service agencies 
and institutions. In commenting on 
the professionally-related consequences 
associated with this expansion, Nadolsky 
(1981) noted that: 

vocational evaluation has 
emerged as a discipline with 
a broad base; it does not identify 
with any one program nor is its 
practice limited by the needs 
of a particular referral source. 

Because of its broad base , 
vocational evaluation has the 
potential to develop an identity 
as an independent profession. 
It has become a discipline that 
must independently establish 
and mai ntai n its own standards 
for professional practice, regardless 



of the specific needs and desires 
of any one program (p. 70); 
Although the development of 
a broad base is not a di sti ngui shi ng 
characteristic of a profession, it 
does establ ish a sol id foundation 
for the independent or autonomous 
operation of a discipline. That 
is, the pervasion if a service into 
various sectors of society not only 
provides visi bil ity to an emerging 
di sci pi i ne , but also decreases the 
likelihood that a specific agency 
or institution will be able to maintain 
a controlling influence over the 
practice of the discipline. Due 
to its pervasive nature , an emerging 
di sci pi ine will eventual ly become 
recognized and accepted by the general 
public for its separate, unique, 
and di sti net service contri butions . 
Furthermore, as the discipline's 
practitioners become involved in 
offering a common program of service, 
which is based on a shared rationale 
and a consistent technology, members 
of the di sci pi ine begi n to identify 
with one another, more so than with 
their particular place of employment. 
Practitioners feel a need to define , 
confirm, and protect thei r identity; 
they take steps to establish formal 
lines of communi cat i on and devel op 
i nternal methods for the regul at ion 
or control of their discipline and 
its practice. For this reason, the 
establishment of a broad base appears 
to be a necessar y, if not sufficient , 
condition for the professional ization 
of a service-oriented discipline. 
And the joint sponsorship of this 
forum suggests that the disci pi ine 
of vocational evaluation has acquired 
such a broad base. 

REFERENCES 

Bellows, R.M. (1940). The status 
of sel ection and counsel ing techniques 
for dental students. Journal 
of Consulting Psychology , 4, 10-16. 

Cronbach, L.J. (1960). Essentials 
of psychological testing (2nd 
ed.) . New York: Harper and Brothers . 



21 



Moskowitz, M.J. (1977). Hugo Munster- 
berg; A study in the history of 
appl ied psycho! ogy. American Psychol- 
ogist , 32, 824-842. 

Nadolsky, J.M. (1981). Pros and cons 
of rehabilitation professional 
association consol idation: Considera- 
tions of VEWAA. Journal of Applied 
Rehabil i tat ion Counsel ing a 12, 
69-71. ~ 

Neff, W.S. (1968). Work and human 
behavior . Chicago: Atherton Press. 

Task Force #1, Vocational Evaluation 
Project. (1975). Vocational evaluation 
services in the human services 
delivery system. Vocational Evaluation 
and Work Adjustment Bulletin , 8 
(special ed.), 7-48. ' 

Tenth Institute on Rehabilitation 
Services. (1972). Vocational evaluation 
and work adjustment services in 
vocational rehabilitation . Menomonie , 
WI: University of Wisconsin-Stout. 

Treat, K. (1929). Tests for garment 
machi ne operators . Personnel Journal , 
8, 19-28. 

Author 

Jul ian M. Nadol sky 
University of Tennessee 
2109 Terrace Avenue 
Knoxville, TN 37916 



CERTIFICATION FOR TEACHERS AND VOCATIONAL 
EVALUATION SPECIALISTS 
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ABSTRACT: The question of what type 
of certi fi cation vocational eval uation 
specialists need to have in order 
to work in secondary schools is a 
problem that is currently facing the 
fields of special education, vocationa 1 
education, and vocational rehabil itation. 
A quick review of the last twenty 
years must be made in order to understand 
how the dilemma was created, and through 
this historical perspective, how it 
might be resolved. 



The decade of the sixties brought 
into full force the Civil Rights 
Movement. . Emotions stemming from 
the Vietnam conflict combined with 
the Civil Rights Movement brought 
about a new awareness of the individual 
differences that exist in society 
and of how these differences contribute 
in their own unique way to make the 
United States function as it does. 
The theme that emerged duri ng the 
sixties was relevancy. What was 
being taught, the work being done, 
and the programs being offered had 
to be relevant. As a result of this 
relevancy theme, questions about 
serving special popul at ion groups 
were asked . These questions were: 
How are we serving the handicapped 
and di sadvantaged? What are their 
rights when it comes to educational 
planning and program offerings? 

The course of the decade of 
the 1970 1 s was charted as a resul t 
of the experiences of the 1960's. 
The time was right for specific pieces 
of legislation — Public Law 93-112 
(Rehabilitation Act of 1973); Public 
Law 94-142 (Education for All Handicapped 
Children Act of 1975 ); Public Law 
94-482 (Educational Amendments of 
1976); Public Law 95-93 (Youth Employment 
and Development Projects Act of 1977) — 
that woul d pro vi de the mechani sms 
through which handicapped and disad- 
vantaged persons could be served 
and trai ned . Because of these new 
social and educational commitments , 
the 1970' s became known as the "tr ial 
programming decade." 

This "total programming decade" 
brought to the field of education 
terms 1 ike mainstreaming, least restric- 
tive environment, deinstitutionalization, 
and normalization. All of these 
terms ha^e as a focus the delivery 
of services to special populat'on 
groups. 

By process of definition, the 
1980's have to be declared the "Imple- 
mentation Decj.de." All of the pieces 
of 1 egi sl-fift i on , theories , and pi ans 
must be put in pi ace in order for 
the targeted groups to be served. 
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The movement of equality of opportunity 
requires that human service agencies 
cooperate together as they develop 
their continuum of services. Three 
of the most involved fields in providing 
education and service to handicapped 
and disadvantaged individuals are 
special education, vocational education, 
and vocational rehabilitation. These 
three fields became intertwined with 
each other as a result of philosophical 
changes in service to and for handicapped 
and disadvantaged individual s and 
federal legislation. 

Special education through P.L. 94-142 
started developing and implementing 
Indi vidual Educational Plans (IEP's) . 
These IEP's are very prescriptive 
and clearly outline where the student 
should be progressing on the education 
continuum. A critical part of the 
IEP is a strategy for training the 
individual for a post high school 
experience, be it work or further 
training. Formany handicapped students, 
vocational training was called for, 
and as a result, special education 
started becoming very involved in 
vocational training with only limited 
experience upon which to call. 

In the meantime , vocational education 
via P.L. 94-482 was setting aside 
30% of its federal dollars to serve 
the handicapped (10%) and disadvantaged 
(20%). Vocational education personnel 
were receiving handicapped students 
into their programs, both mainstreamed 
and separate programs. These vocational 
instructors had little or no training 
in working with special needs youth. 
Many of the placements were inappropriate 
or incorrect. As a result, there 
was confusion and frustration by instruc- 
tors and students as each struggled 
to f i nd out how they coul d survive 
in their educational settings. Initially 
it was a very difficult time for all. 

Vocational rehabi 1 i tat ion was 
receiving much attention through P.L. 
93-112 and the various provisions 
within the law, such as section 504. 
This section makes it illegal to discri- 
minate against the hiring of or admission 
i nto a vocational education program 
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of qualified individuals on the basis 
of their handicapping condition. 

What was occurring was that 
a number of educational and societal 
changes were being made independent 
of each other, but as time went by, 
they slowly started to intertwine 
with each other in terms of a continuum 
of services. This intertwining brought 
about a number of personnel training 
needs in all three of the fields, 
but especially in special and vocational 
education . 

The training needs for special education 
we r e as follows: 

1. Development of appropriate 
IEP vocational components. 

2. Vocational assessment of 
student interests , abil ities , 
and aptitudes. 

3. Proper placement of handicapped 
students in vocational settings. 

4. Placement of students into 
jobs in the community. 

5. Selection of appropriate 
vocational instructional 
materials . 

The training needs for vocational 
education were as follows: 

1. Working with disadvantaged 
and handicapped students. 

2. Vocational assessment of 
student interests , abil ities , 
and aptitudes. 

3. Proper placement of handicapped 
and disadvantaged students 
in vocational settings. 

4. Placement of students into 
jobs in the community. 

5. Selection of appropriate 
vocational instructional 
materials . 

The training needs for vocational 
rehabilitation were as follows: 

1. Integrating into the educational 
mold. 

2. Translating vocational assessment 
results into educational 
placements . 

3. Developing a role for vocational 
evaluation in school settings. 
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4. Utilizing job laboratories 
for student placement. 

5. Understanding the continuum 
of services for handicapped 
students. 

These three lists resulted in 
a scrambl e to trai n the i nvol ved personnel 
in order to better meet the needs 
of the students they were serving. 
This scramble resulted in a lot of 
personnel development programs being 
developed, but, as they were being 
developed and imp! emented , "turf ism" 
started rearing it's ugly head. This 
turf ism was translated into a series 
of skirmishes over where students 
could be counted for funding purposes. 
The federal programs were intended 
to supplement the local school districts 
efforts 3 not supplant them. The students 
then became pawns in a head-hunting 
game by various programs. Each program 
wanted to count the students as theirs, 
so they could get additional federal 
funds. Once the initial implementation 
phase of the new pieces of legislation 
(P.L. 94-142 and P.L. 94-482) passed, 
and the trouble spots in terms of 
funding were ironed out, then cooperative 
agreements were drawn up by the local 
districts between special and vocational 
education. These cooperative agreements 
illustrated funding patterns, responsi- 
bility of personnel, and administrative 
functions . 

There still remained some philosoph- 
ical issues that had to be worked 
out between the two fields in regard 
to methods of delivery of services. 
Special education felt it could best 
offer vocational training within the 
structure in which it operated. Vocational 
education felt since it was in the 
business of training people for work 
it coul d best trai n these students . 
Then on the other hand, vocational 
education wasn't sure that it was 
it's job to train handicapped students. 
Once the dust settled, mutual respect 
for each other's professional expertise 
was developed, and a team approach 
was developed to serve these students. 
Vocational teachers started serving 
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on IEP Child Study Teams, assisted 
in making student placement, and 
offered skill training. Special 
education assisted vocational teachers 
as resources for instructional techniques, 
placement, transfer of academic skills 
to vocational settings, and the develop- 
ment of good employee skills. 

At this point, turfism of a 
higher level again surfaced -- this 
time concerning teaching credential s . 
Vocati onal teachers were teach ing 
handicapped students and they were 
not certified special education teachers. 
Special education teachers were teaching 
vocational subjects, and they were 
not certified vocational teachers. 

Part of this problem again rested 
with the manner of fundi ng these 
programs. The special education 
dol 1 ars required a certi f ied special 
education teacher, if the dollars 
were going to flow into the local 
di strict . This same situation hel d 
true for the vocational dollars. 
There had to be a certified vocational 
instructor involved in the instruction. 

A number of states (examples: 
Nebraska, Washington, Illinois, Idaho, 
Missouri) sought to remedy this situation 
through cross-training and secondary 
endorsements . They created local 
district teams composed of special 
and vocati onal educators . These 
teams were trained in joint programming 
utilizing the expertise from the 
two fields to devel op mutual ly beneficial 
educational strategies. This cross-train- 
ing did not solve the credential 
problems, but it gave credibility 
to what the instructors from the 
two fields were doing. 

Another strategy for solving 
the credential problem was to offer 
a secondary or add-on endorsement 
for special and vocational teachers . 
The special and vocational teachers 
woul d take a series of basic courses 
in the area of vocational training 
for handi capped i ndividual s. Then , 
if they were from special education, 
they would take additional vocational 
training. For the vocational teachers 
the opposite was true; they took 
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additional special education course 
work. 

This secondary endorsement training 
did not make them dual certified, 
but it did endorse them to work in 
parts of each other's program. Progress 
was bei ng made in the of f er i ng of 
vocational training for special popula- 
tions, but much remained to be done, 
both in terms of curricul urn and personnel . 

With any new movement there are 
stages that it goes through and vocational 
training for handicapped individuals 
was no exception. The initial phase 
of placing students in vocational 
programs was over. Demands were being 
made on teachers to make sure the 
placement met the students' needs, 
were proper, and were leading to gainful 
employment. These demands brought 
about a tremendous interest and growth 
in vocational evaluation on the secondary 
school level . The teachers and counselors 
were in desperate need of information 
about the needs, interests, and aptitudes 
of their students. Generally they 
had paper and pencil aptitude surveys 
and the results of an occasional manip- 
ulative device. 

Outside the field of education, 
vocational rehabilitation was developing 
and refining vocational evaluation 
to an even hi gher 1 evel of sophistication, 
but these services and data were not 
readily available to school systems. 
To meet their needs, school systems 
started conducting vocational evaluations 
with the resources they had, both 
in terms of personnel and devices. 

The school personnel were trained 
to conduct vocational evaluations 
by taking a graduate course in vocational 
evaluation, taking training sessions 
offered by sellers of vocational evaluation 
devices, or attending a training session 
offered by an institution of higher 
learning; such as the University of 
Wisconsin-Stout 1 s training, sessions 
offered by the Research and Training 
Center #22. All three of these methods 
served to orientate school personnel 
to vocational evaluation, but in no 
way did it make them vocational eval- 
uators. The problem of how and where 



to secure wel 1 trai ned vocational 
eval uators for school s was created 
and currently the three fields are 
worki ng to re sol ve this problem in 
some logical manner. 

Possible Solutions 

The following discussion will 
set forth a number of possible solutions 
to this dilemma of how to secure 
the "appropriately" certi f icated 
personnel to conduct vocational evalu- 
ations, i he solutions are meant 
only for discussion, as none of them 
are to be perceived as total solutions 
but only as solutions that are currently 
being tried. 

Grow Your Own 

This solution is the most commonly 
used. A district selects a certified 
teacher that is interested in vocational 
eval uati on and sends the i ndi vidua 1 
through a series of short term training 
programs. The training is taken 
where it can be best secured based 
upon financial resources. This method 
results in a certified teacher, which 
is cr i ti cal to the di stri ct when 
they undergo accreditation, and a 
person that is interested in vocational 
education. This method works i f 
the interest of the selected teacher 
is strong enough to do a lot of personal 
study and training to develop the 
competency required of a vocational 
eval ua tor . This sol uti on to the 
probl em has worked wel 1 in a number 
of cases, but it all depends on how 
much the teacher cares. 

Make Me A Teacher 

Another strategy that has been 
employed has been to hire a vocational 
evaluator and then require them to 
become certi f i ed as a teacher . Thi s 
method has made mixed results. For 
exampl e , a vocational evaluator was 
hired with the stipulation that she 
obtai n teacher certification within 
three years. Using a local college's 
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course catalog, she discovered that 
her easiest way to be a teacher was 
to take courses in history. She completed 
the requirements and is now a certified 
history teacher doing vocational evaluation 
full time. This appears to be unfair 
to the vocational e valuator , a professional 
in her own right and in the field 
of history education, because she 
doesn 1 1 want to have anything to do 
with history at all even though she 
is a certified history teacher. 

Developing Respect 

One solution would be to get 
educational agencies and school districts 
to recognize vocational evaluators 
as professionals in their own right. 
They are recognized as such by the 
field of vocational rehabil itation, 
why not education? Vocational evaluators 
would be working parallel to teachers 
and counselors in terms of evaluations 
and referral s. A precedent for inclusion 
of vocational evaluators within school 
settings, not as certified teachers, 
but as certified evaluators, comes 
from speech pathologists. Many of 
these individuals are certified pathol- 
ogists, but not teachers. They practice 
their profession of assisting students 
without the need for being a certified 
teacher. 

The source of certi fi cation for 
vocational evaluators could come from 
the Commission for the Certification 
of Work Adjustment and Vocational 
Evaluators (CCWAVES). This commission 
has established a rigid set of criteria 
and testing in order for vocational 
evaluators to be certified. The certif- 
ication is for a five (5) year period 
and when renewal is needed , record 
of continued education (CEU's) and 
other professional improvement must 
be supplied. This certification much 
parallels the teacher certification 
process. 

State Certification 

State Departments of Education 
are generally the certification officers 



for teachers. These departments 
and the rules under which they operate 
are the entities that must be dealt 
with. School officials and vocational 
re ha b i 1 itation professional s should 
talk with these state officials in 
order for all individuals to understand 
the intricacies of certification. 
Unless this critical step i s taken , 
teachers will continue to conduct 
vocati onal eval uations with 1 imited 
ex pert i se , and vocational eval uators 
will be excluded due to a lack of 
teaching credentials. A joint agreement 
can be developed between the involved 
fields to resol ve the probl em or 
at least to set up a plan where the 
problem can be worked through. 

National Position 

A critical question must be 
as ked at this poi nt . Is there a 
need for certified vocational eval uators 
in school settings? Schools are 
currently getting along with the 
level of trained personnel that they 
have, whether or not they are adequately 
prepared as viewed by the rehabil itation 
field. i,o what is the concern? 
The peopl e most concerned about the 
certification of vocational evaluators 
are those wor ki ng in the area of 
vocational evaluation, both in education 
and rehabil itation. Unl ess national 
associations such as the Nat i onal 
Rehabil i tat ion Association (NRA) , 
Council for Exceptional Children 
(CEC), Division on Career Development 
(DCD), Vocational Eval uat ion and 
Work Adjustment Association (VEWAA) , 
American Vocational Association (AVA), 
and the National Association of Vocational 
Education Special Needs Personnel 
(NAVESNP) join together to develop 
some jo i nt posi ti ons on personnel , 
no progress is going to be made. 
The afore-mentioned associations 
have positions on vocational eval uation , 
but they have not addressed to any 
great depth personnel requirements . 
Thus , by addressing this concern 
and then advertising it, proper training 
can be specified. Then school districts 
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will have an idea of what kind of 
training their vocational evaluators 
should have. 

A benefit of cooperative activity 
between these associations would be 
the development of a continuum of 
vocational evaluation services so 
that the various service providers 
would understand how each fits into 
the model and what they are to do. 
This would greatly facilitate the 
referral process for handicapped i ndi- 
viduals from seventh grade through 
adulthood. 
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Conclusion 



Thi s di scussi on has traced the 
personnel problems created as a result 
of the implementation of federal legis- 
lation providing access to training 
and employment for handicapped individ- 
uals. Using this information, national 
associations involved with vocational 
evaluation must join together to develop 
personnel preparation recommendations 
in order to have well trained vocational 
evaluators conducting vocational evalu- 
ations. If the,} do not, there will 
never by any specific training outlined 
for vocational evaluators in educational 
settings and the certification problem 
will be perpetuated. If they do, 
vocational evaluators will have the 
opportunity to acquire the competencies 
necessary to conduct vocational evaluations 
that will facilitate better placement 
and service to handicapped individuals. 
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MARKETING VOCATIONAL EVALUATION 



ANN WILLIAMSON 



ABSTRACT: This paper presentation 
discusses basic market information 
gathering for the field of vocational 
evaluation. Starting with a discussion 
of service customers, the paper reviews 
the planning of marketing, assessing 
competition , devel oping advertising, 
sales promotion, and market research. 



M. Chairman, attendees. 

Congratulations! It is truly 
an honor to speak with representatives 
of a field that is fast becoming 
the newest of the professions. Vocational 
evaluation finally will be an occupation 
without the question, "But what is 
it that you do?" 

Up until recently I did not 
real ize the impact you have beeh 
havi ng with handi capped populations 
for many years. From my position 
in the advertising/1 itho graphic industry, 
I thought everybody merely decided 
what they wanted for vocation , and 
went around asking potential employers 
or pi a cement agencies unti 1 they 
were hired. But now that I am with 
you, I realize the tremendous science—and 
i nf ormation--that is available in 
the matter of job selection. 

Defining Your Service 

Let us get down to basics. 
Before you begin pi anning your marketing, 
you need to satisfy two steps. Let 
us begin our exploration on marketing 
vocational eval uation with the first 
mar keti ng pri nci pi e : def i ne your 
product. What is the service you 
want to market? 

You have formed an excellent 
reputation i n assisting handicapped 
people to realize their occupational 
potential . Since the 1950's there 
has been more or less full employment 
opportunities in the U.S. for the 
able-bodied, so you have seen to 
it that people who have some disability 
coul d find a place al ongside the 
able person. To do this you tested, 
measured , eval uated and proved that 
disabilities do not necessarily rel egate 
a person to non-existence. 

Tin's expertise was well -devel oped 
when i ndustry and i nsurance began 
to cry out for your help in Worker's 
Comp cases . Now state and federal 
government realize that you hold 
the science for releasing or retaining 
di sabi 1 i ty cases in the matter of 
truly-needy relief rolls. But this 
is not the end of your booming expansion. 
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The U.S. now has a tremendous 
displaced worker probl em—added to 
the able-bodied, hard-core unemployed—an 
enormous population with 1 ittl e awareness 
of your well-developed methods. Many 
of our agencies are now expanding 
to include these unfortunates. There 
are no physical or mental handicaps 
in this group--just the monumental 
handicap of trying to figure out the 
best vocation given the person's makeup. 

But your future does not stop 
there. Have you heard about the tens 
of millions of employed persons who 
are actively searching for "something 
better" to do? They have no one to 
turn to for the quality of vocational 
evaluation that could lead to 
better- informed job selection. 

Define your service before you 
even think about marketing. Look 
at your choices by type of population 
and source of business: 

Physical ly/Mental 1 y handicapped 
persons — usual ly come to you from 
government or private sources or families 
of individuals. 

Worker 5 s Compensation cases— referred 
by insurance companies and lawyers. 

Disability ca ses-- referred by 
judicial and medical professions or 
i ndi vidua 1 s themsel ves . 

Displaced workers-- referred by 
industry, union and government. 

Hard-core unempl oyed- -referred 
by government and JTPA. 

Chemi cal abuse cl ients— referred 
by medical professionals and penal 
groups . 

Ex- of fenders-- referred by prison 
system. 

Distressed empl oyed- -refer red 
by individuals themselves, or employment 
services . 

Young people, not yet employed— 
referred by high schools, and colleges. 

While many of you now handle 
cases from several of these populations, 
your expansion goals are moving slowly, 
and for good reason. Can you really 
handle a 50-year-old who's lost his 
life job at the same time as a mentally- 
retarded youth? Can you mix severely- 



disabled former workers with alcoholic 
rehabilitation clients? 

How can you express what you 
do to each of these sources for more 
business? The words you use to explain 
your ex- offender eval uation program 
to the prison system must be different 
from the words you use to families 
of the physically- handicapped. Your 
appeal to the legal and medical profession 
for Worker 1 s Comp cases must be different 
from your appeal to PIC councils. 

I assure you that you cannot 
be e ve ry th i ng to everybody . You 
cannot sit under one banner and the 
same message , and hope to attract 
more of each of these problem areas. 
You will not be credible. Even though 
you are incredibly competent for 
all areas. 

The marketing professional will 
tell you to go after the largest 
market just for percentages 1 sake. 
I'm not going to tell you that, because 
you must find your own niche, your 
own specialty based on personal expertise 
and preferences. All I can do is 
warn you that temptation for expanding 
i nto various markets at the same 
time could do you in. It may ' ppear 
to be easy for you now to define 
your service, but future expansion 
areas are closer than you may imagine. 

The other point to satisfy—along 
with defining your "product" or 
service — is you must be aware of 
your rate of production. You cannot 
be comfortable with your selling 
prices without knowing how much service 
you can offer per given time period. 
The fact of the matter is whether 
you are appealing for funding or 
establ i shing a price for private 
caseloads, you must know your level 
of ef f i ci ency and w hy you work at 
that rate of speed . 

Your rate of production depends 
both on attitude and on the tools 
you use. As all of you know, some 
agencies press for a maximum turnaround, 
others for a more slow-paced, thorough 
evaluation. In either case, your 
marketing plan must be able to defend 
what your attitude is. In all your 



30 



cases, however, there is pressure 
for more efficiency. 

New evaluation tools on the market 
are responding to this change in your 
field. Historically, you were able 
to spend a great deal of time with 
a client; now there simp! y is not 
enough money available in the U.S. economy 
to allow leisure in production. Your 
major tools must be geared to evaluate 
the majority of your clients in less 
time than you were allowed to spend 
in the past. Other evaluation methods 
should remain available for you to 
use with those clients who are more 
difficult to assess or who present 
greater problems for evaluation. 

I think our company— Career Evaluation 
Systems, Inc. --has now experienced 
this pressure for more efficient evaluation 
tools from both ends. When our human 
factor testing and computerized scoring 
method first came out 7 years ago, 
we were criticized for being too fast; 
now there is pressure from you eval uators 
for us to speed up our systems even 
more. Seven years ago a 5 1/2-hour 
test battery plus computer scoring 
by mail was the latest thing. Now 
that we have a 3 1/2-hour test and 
i nstant tel ecommuni cation scoring 
we find ourselves in a marketing dilemma 
of competing with a 1/2-hour evaluation 
method! 

Do not get me wrong. I am not 
on the side of faster is better. 
I am merely explaining this as a concept 
to keep in mind in justifying your 
rate of production. My company has 
taken a stand that 3 1/2 hours of 
tests are necessary for a quality 
evaluation tool, and that telecommuni- 
cation scoring will save evaluation 
funds in the long run over producing 
changeabl e software packages . With 
this as full knowl edge ,' we will market 
our product and service no matter 
what the faster methods are trying 
to do . Around the of f i ce we have 
a saying that we have really become 
the Cadillac of evaluation systems, 
but now we are priced like a Chevy. 

This is the kind of knowledge 
you must have before you begin your 



marketing. Define your service and 
be comfortable with your r?te of 
production. 

The Aspects of Marketing 

Now we are ready to talk about 
marketing. Before we go another 
step, though, can any of you remember 
who a janitor was? He (it was always 
he) kept the fire stoked in the furnaces, 
shoveled coal, could fix anything-- 
electrical, plumbing, carpentry, 
your car--and kept the premises in 
good order, he was either very friendly 
or very grumpy, but there was no 
question about who the janitor was 
and what his jobs were. 

Today janitors are called building 
engineers. They rarely do any of 
the above tasks themselves, though 
they are always busy explaining why 
something happened as it did and 
promise to "have a man over right 
away to fix 4 t." They are always 
polite and politically minded, and 
often can be mistaken for the adminis- 
trator. 

Do not tell anyone, but "marketing 11 
is to "building engineer" as "selling" 
is to "janitor ." Do not 1 et the 
title of marketing get out of hand; 
what you are trying to do is sell. 
You want to interest people in spending 
their money on your program. What 
you do in the name of marketing shouldn't 
keep you from actually getting the 
selling done. 

Perhaps we should define four 
separate aspects of marketing. To 
name them, there is (1) the planning 
stage, (2) assessing the competition, 

(3) the advertising stage, and finally 

(4) sales followup. 

The Planning Stage 

Planning your marketing attack 
is crucial. We have already defined 
your service and made you comfortable 
wi th your rate of production . Now 
we need to pinpoint who you wish 
to sell your service to. It's called 
"identifying your markets." 
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If you are in a position to apply 
for community or government funding, 
either you already have a tried and 
true method of attracting these funds 
or go out and hire an expert. This 
is a highly stylized method of selling 
your services and rarely works in 
amateurs 1 hands. 

Another increasingly popular 
source for funding is appealing directly 
to industry. The impetus in federal 
government programs now is to encourage 
business to support local services 
such as yours. The important point 
to remember in a pproachi ng busi ness 
and industry, however, is that you 
must thoroughly describe how giving 
money to you will benefit them. Do 
not be critical of this attitude; 
they have limited funds for community 
service, and need to justify that 
no money is "wasted. 11 An area where 
they surely would benefit is your 
expertise in identifying particular 
jobs for people who would otherwise 
end up on relief rolls or at extensive 
worker's compensation. Businesses 
(and for that matter all taxpayers) 
want to see the unnecessary handouts 
to i ndi vidual s decrease . Other areas 
where business will benefit should 
be based on particul ars in your community. 

For those of you who service 
the community on an individual basis 
by direct counseling fees, you are 
into what is called "consumer marketing. 11 
You have to plan your marketing attack 
through general public media. This 
approach includes signing up for local 
radio & TV talk shows, getting articles 
about your organization in newspapers, 
as well as paid advertising campaigns 
which we will get into later. 

Al 1 these di f f erent market approaches , 
however , need one addi ti ve you may 
not know about. The classic example 
in marketing textbooks is the liquid 
entertainment field. Let's say you 
want to introduce a new beer on the 
market. First you hire a dozen or 
so shills. These people walk into 
assigned bars, and ask for the beer 
that no one knows about yet. They 
talk about the virtues of the new 



product, sometimes refuse any alternative 
drinks that are offered, and walk 
out. This goes on for a period of 
time , until the beer distri butor 
call s on the bar. Lo and behold, 
he has this great beer for sale, 
and the bartender says "I have had 
a lot of people ask me for that lately-- it 
must be real 1 y popul ar— yes , I wi 1 1 
take some cases." 

This is called "creating consumer 
demand." If your marketing target 
recognizes your name and service 
when you make contact, you have a 
much better chance of a sale. Perhaps 
you could use the "shill" approach—maybe 
done with phone cal 1 s to your identified 
mar kets — or other methods that call 
for creating demand, such as requesting 
your satisfied clients to talk about 
your organ izat ion. Getting your 
name generally recognized in your 
market makes selling a lot easier 
and less expensive. 

The final step in planning is 
to establ ish a budget for your marketing. 
Naturally you don't have many dollars— no 
one does. But you have to spend 
some money to attract busi ness , and 
preparing a budget is important. 
There are two rules of thumb you 
can go by: (1) for every 100 contacts 
you ma ke , your mar keti ng is doi ng 
well to attract 10 inquiries, not 
all of whom will buy your services; 
and (2) for every case you handle, 
allow about 20% of the price you 
charge for your mar keti ng budget . 
Later we will explore how to use 
these funds wisely. 



Assessing the Competition 

Do not forget the competition. 
Establish, first, how you 1 re different 
from your competitors. Make a T-chart. 
List what you do on one side of the 
chart, and what your competitors 
do on the other side. If you do 
not know what your competition does 
or how they charge , find out. Even 
if the facts are hard to take— even 
if they are cheaper and better than 
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you—you must know your competition 
before you can plan your attack. 

This is where the creativity 
begins. Let me give you an example. 
Computer scoring of tests in our evaluation 
system is done by telecommunications 
with persona "1 computers. We recognized 
that some of our competitors sell 
software packages to do on-site computer 
scoring, and we were getting criticism 
from potential users about our scoring 
methods. There was only one thing 
for us to do; make telecommunications 
the more attract i ve approach , putti ng 
the competition on the defensive. 
Because we truly be! ieved that our 
method was superior, we only needed 
to state why. 

Since we promise computer system 
updates, never with an additional 
charge (and changes are imperative 
fairly often in computer software!), 
we raised the question in the buyer's 
mind of how much he's going to be 
spending with competition every time 
their software is revised. We also 
made the statement that we would not 
al 1 ow evaluators to use something 
of ours that was outdated simply because 
there's no money to buy the updates. 
Plus we also gave the computer's modem 
software free of charge with our systems, 
so the computer user has tel ecommuni cation 
access to all sorts of other data 
bases. In other words, we launched 
an of fensi ve-- because we were sure 
the buyer would be better off financial- 
ly — to counter a trend which could 
have made us appear to be on the def ensi ve . 

If your competition is cheaper, 
state how your service is more thorough 
and gives superior results. If they 
are faster, state how much more service 
you offer. Use what you believe in 
about your service, and make your 
competition defend themsel ves against 
your criteria. 

The Advertising Stage 

Now we are ready to spend those 
budget dollars. The advertising stage 
is where you decide what media will 
be best- - both to reach your markets 



successfully and to stretch your 
available dollars. Briefly, advertising 
media can be listed in order of most 
expensive first: tel evi si on commercials, 
radio spots, billboards, printed 
di spl ay advertising (newspapers , 
magazines), direct mail, bulk pamphlet 
del ivery to individual -handout locations, 
and on-site handout materials. 

Do not ever be without the last 
media. On-site handout materials 
are the least expensive advertisi ng 
materials and a very effective way 
to advertise. You are in touch with 
people who were interested enough 
to be at your location. Give them 
two copies — one to pass along to 
friends . 

If you have not already, develop 
at least one central printed piece 
of 1 i terature for yoursel ves --such 
as a pamphlet. If you have the funds, 
go to a smal 1 adverti si ng agency 
which will write, design and have 
printed the number of copies you 
need. If you do not have money for 
the price they quote you, writing 
the copy yourselves will save those 
extra dol 1 ars . Be sure to descri be 
your history, what your services 
are, and who they should contact 
for more information. Do not include 
prices or schedul es , because these 
may change before you run out of 
co pi es . The main thing is to have 
the design and printing done very 
well. Everyone you want to contact 
is accustomed to beautifully executed 
printing— most of the junk mail now 
is superb! The best quality at a 
reasonable price is available to 
you at a medium-size printer who 
al so has a types etti ng department. 
They will work within the budget 
figure you give them, but plan to 
spend at least $.25 each in the 2-3,000 
copies quantity. 

This piece of literature is 
mul ti- purpose , for it can be used 
in di rect mail campaigns as wel 1 
as for handouts . Whether you are 
a funded or a fee-based organization, 
direct mail should be one of your 
advertising choices. Company managers 
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indicate that direct mail advertising 
provides their purchasing initiative. 
Individuals receiving direct mail 
with an easy response form are more 
apt to at least inquire about you 
than if they see a telephone number 
in a short TV ad. 

Direct mail , however, comes in 
"campaigns," not as a one-shot effort. 
Plan to use your mailing list at least 
three times within a four-month period 
for the optimum results, with a different 
letter but same theme each time. 
Always include some kind of return 
mail response card . While mail i ng 
lists are available for purchase, 
you probably are better off developing 
your own list; you can be more specific. 

If you are a fee-based organization, 
begin to save your pennies for display 
advertising. Your least expensive 
display would be in your local newspaper 
or community ad booklets for special 
events. For magazine, billboard, 
radio and . TV display ads, you will 
need an advertising agency's services. 
As a fee-based service, you are as 
much a consumer-oriented group as 
your local hospital or community coll ege. 
Find out how they advertise in your 
area. Sometimes the public relations 
manager of these institutions can 
give you extra help if you ask. 

For the advertising stage of 
marketing, however, there is one 
overpowering concern no matter what 
media you choose: how you say your 
message. If you do not describe your 
services so they are understood, you 
will have only a small result per 
dollar spent. Frankly, when I came 
into your field, it took me nearly 
a year to understand the vocabulary 
you use. I read all sorts of advertising 
literature, newsletters and magazines- 
only to find 40,000 acronyms, shortened 
words and initials used in place of 
real words. The computer industry 
has nothing over on you! 

You should not use your field 
vocabulary when you are advertising. 
You must speak the language of the 
markets you are trying to attract. 
Most do not 'know what you are selling 



for "voc rehab, EMR, work hardening, 
extended shelter employment." Instead 
of using your usual terminology and 
trying to define it, state your services 
in terms of and on the 1 evel of newspapers 
(or what your 13-year-ol d brother 1 s 
friends would understand). 

You will find this very difficult 
to do , because "voc rehab 1 ' means 
voc rehab or vocational rehabilitation 
to you- -not "we assist handicapped 
peopl e to di scover potenti al jobs 
they can hold." Even when you are 
advertising to peopl e who shoul d 
know your field--such as state vocational 
counsel ors--you will have more impact 
using every-day terminology. 

I should add that you are not 
alone in this vocabul ary probl em . 
Every occupational field has its 
shorthand that means little or nothing 
to the outside world. That is why 
there is an advertising field--to 
interpret what the in-groups want 
to say to outsiders so products and 
services can be sold. If you do 
not have the budget for an interpreter, 
practi ce experimenti ng wi th words 
to come up with understandable messages 
for your different markets. 

My company recently went through 
this very routine. In speaking with 
community colleges about our evaluation 
system designed for use by the general 
public, we said we measured aptitudes. 
The messages we got in response were 
very negative--to the effect that 
aptitude tests are no good. We had 
been having trouble with the term 
"apti tude" anyway in the voc rehab 
field, because we measure and use 
aptitudes quite differently than 
other voc rehab methods. So we decided 
now was the time to clear away this 
confusion altogether. 

We decided to return to the 
exact phraseology of the science 
our systems are based on: human factor 
testi ng. We provide a human factor 
profile of an individual and link 
that profile directly to the DOT's 
Data-People-Things codes for potential 
vocations . May I say we now have 
a winner. The general public which 
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wac turned off by a si ngl e word now 
listens and agrees with the principles 
of your methods. This is the kind 
of vocabulary discovery routine you 
are gcing to find rewarding. 

Sales Followup 

We are closing in, now, on the 
final step in marketing. Closing 
is the exact term to use. Nothing 
is sold until "the sale is closed"--until 
you have their promise or the money 
for your services. You can market 
and advertise and express yourself 
well until you are blue in the face, 
but you will not have positive results 
without sales followup. 

The routine is very simple: 
(1) keep files of the advertising 
you send to every person, (2) talk 
(by phone or personally) to everyone 
who responds to your advertising, 
(3) talk again and again until the 
sale is made, and (4) advertise later 
to people who haven't yet responded. 

I a 1 ready know your react ion. 
"But I am not a salesperson! I do 
not know how to talk people into buying!" 
well, in just a few moments, I am 
going to convince you otherwise. 

First, the traditional sales 
approach is no longer ef fecti ve . 
You will not be able to push someone 
to buy your service in the manner 
you imagine sales is done. Think 
about it for a moment. Chances are 
that you buy only from people who 
can help you out with their product 
or service. Chances are that you 
avoid the kind of sales approach that 
sounds like a pitch. Most people 
today buy only when they believe their 
life will be better off because of 
the purchase. You are already selling 
all day long. Your job is hel pi ng 
clients. You establish a rapport 
with them, find out their needs, and 
then convince them that your service 
is making their lives better. Use 
this same approach in sales followup. 
Establish a rapport by discussing 
the buyer's needs, talk about how 
you can hel p them by usi ng your services , 



convince them from examples of how 
you have hel ped others in their position. 

Let us take a really tough example: 
getting a larger caseload from a 
DVR counselor. Assume you have laid 
al 1 the groundwork I have tal ked 
about so far. Follow up by calling 
the counsel or-- just to find out what 
he/she feels about the evaluations 
you have been sending. Are they 
what is wanted ? Are your reports 
easy to understand? What coul d you 
do to help out more? What are his/her 
pr o bl ems? From the conversation, 
you may find making a slight adjustment 
will give you more cases, or you 
may be able to clarify something 
in his/her mind. But offering to 
hel p today , and when you cal 1 agai n 
later — and again later on — will convince 
the counsel or that he/she's going 
to be better off sendi ng you more 
cases. This is sales followup. 

Market Research 

I would be remiss in closing 
without mentioning there is a very 
technical area to marketing called 
market research. To be truthful 
about market ing--or building 
en gi neers — techni cal experti se in 
complex relationships is the difference 
between that and selling—or a janitor's 
position. My marketing research, 
however , i ndi cated you needed more 
emphasis on the practical aspects 
of marketing today. 

If you have funds to work with, 
you would profit by a marketing expert's 
survey and report on your organization 1 s 
present and future position in the 
community. It probably would not 
be fruitful for you to try this your- 
selves. There are some general trends 
in mar keti ng vocational eval uation , 
however, you should be aware of. 

The wor 1 d economy has forced 
the U.S. into a different role in 
i ndustri al growth and productivity 
rates. We no longer domi nate the 
worl d ' s economy and are 1 osi ng our 
former i ndustri al leadership. This 
means we will be undergoing significant 
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changes in occupational fields as 
we are forced to move into new enter- 
prises, and an entirely new dimension 
will be given to the term "vocational 
rehabil i tation." 

Since 85-90% of the U.S. economy's 
product i s pa i d out in the form of 
wages, more governmental attention 
and resources will be afforded to 
d i s pi aced workers , to get them back 
into income-producing, taxpaying situa- 
tions , than will be given to persons 
who are not able-bodied. Therefore, 
services to the handicapped in vocational 
rehabilitation will have to be funded 
more from private sources than government. 

Vocational evaluators will be 
trained to serve the general public, 
for present placement, or personnel 
services do not have the expertise 
to reliably advise changing careers. 
Due to the mass of people involved 
in a career predicament, the professional 
will be given less time per client 
with additional demands for greater 
reliability in satisfactory job pre- 
diction. 

You must stay aware of the changes 
around you and be prepared to alter 
your marketing emphasis to satisfy 
new needs. There is a great future 
in vocational evaluation, but beware 
of how to appeal to your emerging 
markets! You may find new markets 
do not want to be "evaluated." Perhaps 
you will become "vocational match-makers" 
instead! 
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NORMS , RELIABILITY AND VALIDITY IN 
COMMERCIAL VOCATIONAL EVALUATION SYSTEMS: 
A CRITICAL REVIEW 



KARL F. BOTTERBUSCH 



ABSTRACT: Dr. Botterbusch espouses 
the belief that work samples are very 
useful tools for the assessment of 
disabled persons and others. He states 
that they have a future, however, 
some problems still need to be addressed. 
First, this paper examines the general 
lack of research on the bulk of available 
work sampl es . Norms , rel iabil i ty , 
and validity are areas where research 
needs to be performed. Further, the 
paper examines why so little research 
exists and how this state of affairs 
can be changed. 



As most of you know, I have 
been wri ti ng about , studyi ng , and 
developing audiovisual materials 
on the various commercial systems 
since joining the staff of the Materials 
Development Center (MDC) in 1972. 
Prior to that time I was employed 
by the U.S. Department of Labor; 
one of my major duties was to conduct 
a series of research studies on the 
Philadel phi a JEVS. I entered vocational 
rehabil i tation and vocational eval uation 
partly as a result of my work with 
the JEVS system. At the time I joined 
MDC and Stout one of my goals was 
to be abl e to 1 ink the obvious advantages 
of work sampl es wi th the empirical 
rigor of psychometric theory and 
practice. Unfortunately, I have 
not been able to accomplish this; 
in my judgment neither has anyone 
else. With a few notable exceptions, 
research with work samples has been 
considered more of a public relations 
matter than a felt need to provide 
professionals with tools of known 
usefulness of helping disabled persons. 

Work sample systems were initially 
developed using federal money (e.g., 
Rehabilitation Services Administration 
for the TOWER and Manpower Admi ni stration 
for the JEVS) to produce a practical 
re pi acement for psychological tests . 
I strongly believe this was a reaction 
against psychological testing practices 
that simply were not valid for many 
di sad van t a ged and disabl ed persons . 
In the late 1960's and early and 
middle 1970's, work samples were 
seen as a cure for all assessment 
problems: clients liked them because 
they were more interesting than tests, 
professional s were satisfied because 
they were not tests and gave at least 
the appearance of reality. At ..hat 
time some of the leaders in the field 
of vocational eval uation wer* openly 
hostile to any research. Work samples 
were seen as the way to assess clients 
without research, and without having 
to critically assess the shortcomings 
of an emerging profession. 

My own opinion is that work 
sampl es have a future and are very 
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useful tools for the assessment of 
disabled persons and many other persons 
as well. However, the time has come 
to begin to solve some of the prohlems 
of overenthusiastic response and inadequate 
research. 

A General Uck of Research 

Spergel (1970) reviewed the vocational 
evaluation literature to 1970. He 
assembled 612 separate listings in 
vocational rehabilitation; 204 of 
these dealt with vocational evaluation. 
Of these only 58 or about 10 4 x> dealt 
even remotely with research. The 
only significant study mentioned was 
the original JEVS (1968) "Signposts" 
study. It is now 1984 and my review 
of the research literature on work 
samples forced me to the same 
concl usions—there is a definite lack 
of data when dealing with work samples. 
Evidence for this conclusion is presented 
later in a review of the literature 
in norms, reliability, and validity 
for commercial vocational evaluation 
systems. 

Norms 

Norms are used to compare a client's 
performance with the performance of 
one or more groups. Norms are usually 
classified according to their source; 
the most often cited sources are: 
client, general population, ^taff, 
training or school norms, predetermined 
time study standards, and employed 
worker norms. A minor controversy 
has been whether client norms are 
relevant. Some persons believe that 
competitive standards or norms are 
unfair, while others contend that 
as long as the goal of vocational 
rehabilitation is competitive job 
placement, only employed worker and/or 
industrial standards should be used. 
The CARF Vocational Evaluation Standards 
(Sax , 1981) contain the following 
standard on norms: "c. competitive 
norms or industrial standards should 
be established and used." To this 
VEWAA initiated standard, I would 



like to add that if competitive norms 
are used the following information 
should be available: 

1. Complete description of the sample 
including: number of subjects 
(sample sizes should be large 
enough to permit statistical treatments 
of data and to cover the full-range 
of ability expected to take the 
work sampl e) ; mean, standard deviation, 
median and range of ages, years 
of education, and I.Q.; percent 
male and female; percent of each 
type of disability; and the dates 
and location of testing. 

2. A clear description of the procedures 
used to obtai n all data ; these 
should be precise enough that 
the study could be repeated. 

3. A full statistical treatment of 
the results: means, standard 
deviations, ranges, medians, semi- 
quartile ranges and estimates 
of skewness. 

4. If industrial standards are used, 
the above three standards do not 
apply. Descriptions of industrial 
standards should contain: a descrip- 
tion of the method used, with 
references , a brief descri ption 
of the person(s) or organization 
performing the study. In addition, 
all standards should be converted 
to minutes, etc. for ease in use. 

I attempted to apply the VEWAA-CARF 
standard and the above cri teria to 
the description of the norms for 
15 systems described in A Comparison 
of Commercial Vocational Systems 
(Botterbusch, 1980). The following 
work sample systems met most of either 
the psychometri c and/or i ndus trial 
standards : 

1. McCarron-Dial— Manual and research 
publications contai n perti nent 
empirical and statistical character- 
istics of the various norm groups. 
Norms are available on various 
disabled samples. 

2. Valpar Component Work Samples- 
Met hod- Times- Measurement (MTM) 
standards and em pi oyed workers 
norms are available. Worker norms 



are adequately described, but sample 
sizes are only 50. 

3. Vocational Eva! uati on System (Singer)— 
Uses employed worker norms and 
MTM standards. Samples described 
adequately. 

4. Vocational Information and Evaluation 
Work Sampl es (VIEWS)--This system 
has MODAPTS predetermined time 
standards. 

5. Wide Range Empl oya bi 1 i ty Sample 
Test (WREST)--Norms are available 
on employed workers with adequately 
defined samples. 

Another aspect is the development 
of local norms. Some work sample 
developers encourage the development 
of local norms; either because they 
really believe in the^r value or as 
an attempt to shift the burden of 
development costs to the purchaser. 
Local norms for tlie JEVS were presented 
in two separate articles. Muse and 
Haines (1981) and Flenniken (1975) 
found differences batween the JEVS 
published norms and locally developed 
norms and concluded that published 
norms are not appropriate for all 
groups. In another article, Flenniken 
(1974) noted the skewness of the JEVS 
norms for many work samples. Although 
he apparently attributes skewness 
to the scoring methods and cutoffs, 
it must be remembered that it is not 
too uncommon to find skewed distributions 
in tests of specific aptitudes. My 
hunch is that these skewed distributions 
are an acceptable sample of several 
traits that are in reality skewed. 

Reliability 

The most basic definition of reliability 
is consistency. We must ask: "If 
the work sample were to be given this 
afternoon, tomorrow, or next week, 
would the client score the same or 
have relatively the same score within 
the group?" (Botterbusch , 1981). 
Reliability is important for both 
practical and statistical reasons. 
If a person 's performance is inconsistent 
or of unknown consistency, we have 



no way of knowi ng if the cl ient 1 s 
performance would* be different at 
a different time. In psychometric 
theory the upper limits of validity 
are determined by the reliability 
of the measuring instrument (Guilford, 
1954) . This does not mean that rel iable 
instruments are valid; it means that 
an instrument must first be reliable 
before it can be valid. 

In work samples the most common 
and most practical method of determining 
reliability is by test-retest measure- 
ment. The work sample is administered 
twice at varying times and the scores 
on both administrations are correlated. 
There have been few studies of work 
sample rel i a b i 1 i ty separate from 
those reported in their respective 
manuals. An inherent problem with 
work samples is their lack of consistency 
between administrations; even the 
best designed parts wear, evaluators 
are not consistent, materials differ 
from administration to administration, 
and environmental conditions vary. 
Because of these factors , one cannot 
expect work samples to have the same 
reliabilities that a well-developed 
psychological test like the GATB 
or WAIS has. (An aside--in the 1940's 
and early I960 1 s military psychologists 
did much experimentation with work 
sample techniques and gave up because 
they could never get the instruments 
to a satisfactory level of reliability 
prior to validation studies.) 

In reading a work sample manual 
to decide if it has adequate reliability 
the user must ask two questi ons : 
(1) does the manual contai n compl ete 
description of the methods used in 
the study; and (2) how high are the 
reliability coefficients for the 
individual work sample or system? 
To answer the first question, carefully 
read the method of the the study 
and find out if the number of subjects 
was adequate; if the methods made 
common sense; and if you could repeat 
the study in your eval uati on unit 
without additional information. 
The second question then must be 
asked "how reliable must a work sample 
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be before it is of practical use?" 
My personal judgment is that it should 
have a delayed test-retest reliability 
of at least .70; this only accounts 
for about half of the total variance. 
There is one more consideration; some 
reported reliabilities have been suspi- 
ciously high. Test-retest reliabilities 
usually do not approach .95 or higher. 

Using the criterion of at least 
.70 for test-retest coefficients and 
complete explanation of the method, 
I reviewed A Comparison of Vocational 
Eval uation Systems and concluded that 
the following work sample systems 
have adequate reliability: 

1. Career Evaluation Systems--Test-retest 
reliabilities after four weeks 
ranged from .72 to .95. 

2. McCarron-Dial --Most data used 
test-retest methods and reported 
correlations in the high .80's 
and low .90's. 

3. Micro-TOWER--Usirn ,fi uarnate forms, 
internal consistency ^nd test-retest 
methods, coefficients ranged from 
.74 to .94. 

4. Vocational Eval uation System (Singer )~ 
Cohen and Drugo (1976) reported 
test-retest reliability coefficients 
of .61 to .71. 

5. Wide Range Empl oyabil ity Sample 
Test (WREST)--Test-retest coeffi- 
cients for employed workers over 
a three month period were in the 
low .90 ! s. 



Validity 

Validity is the bottom-line for 
work samples; you can have excellent 
norms based on working populations 
with high test-retest reliabilities 
and, yet, a work sample or system 
may not be valid. Validity is how 
well the instrument measures what 
it is designed to measure. Does the 
clerical work sample assess the client's 
performance on a receptionist job? 
While there are several types of val idity , 
the critical thing is that each type 
must be related to outside criterion. 
There are three major methods of estab- 
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lishing validity: content, construct, 
and empirical . 

Content validity involves the 
development of a test or work sample 
against a quantifiable standard , 
such as job analysis or a curriculum 
outline. Vocational evaluators have 
traditionally relied on the DOT and 
job analysis as the basis of validity; 
they usually have not gone any further 
than this. Content validation carried 
out in a rigorous fashion can be 
very useful. The job-task matrices 
in the Singer work sampl es represent 
a good start in this direction. 
It appears that most work sample 
developers assume that if a task 
can be rel ated to a parti cul ar job 
in the DOT then they need go no further. 
The four monographs by Robert M. Guion 
( 1979) present a sol id basis for 
the thorough development of the concept 
of content validity. However, the 
mai n concern of this paper is on 
con struct and em pi ri cal val i di ty , 
and especially on empirical validity. 
Both types require considerable time, 
effort, and money. It must be made 
clear that I am not talking about 
a one shot study. There should be 
a conti nui ng val idation program for 
each evaluation system by each developer. 
A review of A Comparison of Commercial 
V ocational Evaluation Systems and 
the 1 iterature reveal ed that no evaluation 
system, except the McCarron-Dial 
has reported conti nui ng val i dation 
studies in the 1 iterature; most evaluation 
systems have totally unknown construct 
and/or empirical validity. 

Several predictive validity 
studies were reviewed as examples 
of what can and should be done. 
Gannaway and Sink (1977) validated 
17 Singer work samples against a 
cri terion of job pi a cement. Using 
117 subjects, correlations were made 
between a compos i te of work sampl e 
time and error scores with success 
on jobs that incl uded the same tasks 
as in the work sampl es . Al 1 correlations 
were in the right direction, but 
small sample sizes precluded any 
reachi ng stati sti cal si gni ficance. 
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Two studies dealt with the McCarron-Dial . 
Dial et al . (1979) attempted to validate 
the McCarron-Dial against a criterion 
of program outcome (i.e., day care, 
work activity center, extended sheltered 
employment, transitional sheltered 
employment and community employment). 
Program levels were predicted by the 
McCarron-Dial; six months later the 
actual program placements were matched 
against predicted levels using chi 
square techniques and multiple correla- 
tions. All results were highly signifi- 
cant. In a study with a similar design, 
Fortune and Eldredge (1982) correl ated 
piece work rate, work performance 
rating, vocational program level and 
residential program level with McCarron- 
Dial results. All results were signifi- 
cant. Berven and Maki (1979) related 
performance on the JEVS work samples 
to the attainment of competitive employment 
with a sample of 233 DVR clients. 
They found that seven of the 20 work 
samples were significantly related 
to competi ti ve empl oyment . They suggested 
that these seven might be enough for 
assessment and, therefore, the entire 
battery was not needed. However, 
these were weak relationships and 
additional research is needed. Perhaps 
the largest published validation study 
performed was an attempt to validate 
TOWER against a criterion of vocational 
instructor's and workshop supervisor's 
ratings (ICD, 1967; Yater, 1964). 
This five year study was conducted 
in seven facilities using the TOWER. 
The conclusion was that: "Disregarding 
detail, the overriding finding of 
the present study is that very meager 
relationships have been found to exist 
between TOWER evaluations and vocational 
outcomes" (ICD, 1967. p. 44). 

There have also been a few construct 
validation studies that must be men- 
tioned. Backman et al . (1979) correl ated 
Micro-TOWER and GATB scores for 903 
clients, mostly young adults. After 
the intercorrelationmatrix was developed, 
a principal components factor analysis 
with a varimax rotation was performed. 
Five factors accounted for 85% of 
the variance: Clerical perception, 
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motor skills, verbal ability, spatial 
perception and numerical ability. 
The conclusion was that Micro-TOWER 
assesses five general aptitudes. 
Final ly, Jones and Lasi ter (1977) 
compared the mean time and error 
scores of employed workers to the 
norms on three Val par work sampl es: 
Multi-level Sorting, Whole Body Range 
of Motion, and Eye-Hand-Foot Coordina- 
tion. The result was that the working 
sample had less times and less errors 
than non-workers, The authors suggest 
the use of industrial norms. 

My conclusion is that it is 
a sad state of affairs when one can 
summarize most of the research done 
on work sample systems in a few pages. 
We must ask why and then ask how 
this situation can be corrected. 

Why There Is Not More Research 

This section attempts to answer 
why there is a lack of research in 
vocational evaluation systems in 
general and especially why so many 
systems have been marketed Drior 
to adequate development. This problem 
is a joint responsibility of both 
system developers and purchasers. 
From the early 1970's to perhaps 
recently, both of these groups have 
fallen victim to what I like to call 
the "mystique of work samples." 
When we first got serious about serving 
disabled and/or disadvantaged persons, 
we soon concl uded that many tests 
were not appropriate or useful for 
these groups. Work samples offered 
an attracti ve al ternati ve . Because 
they appeared to be job related and 
rel ated to the DOT, most persons 
took them on their face validity 
and on uheir limited content validity 
to the DOT. The naive assumption 
was that since they related to supposi- 
ti vel y "real work' 1 nothing more was 
needed; certainly not the rigorous 
research that characterized some 
psychological development. To use 
E. G. Boring's (1957) word, this 
was the "Zei tgei st" of the time , 
and most of us agreed with it. 
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In addition to this overall consensus, 
both evaluators and developers whole- 
heartedly accepted unproven work samples 
for a variety of reasons. Some of 
these are listed below; let's start 
with evaluators. 

1. Rapid Growth of the Fiel d— During 
the 1970's the demand for trained 
eval uators far exceeded the supply 
of qual if led persons . Supervisors 
and evaluators attempted to make 
up for this shortage by turning 
to technology with semi-trained 
persons rather than to trust the 
experience of trained professionals. 

2. Desire to be "Scienti f i c"--Thi s 
is part of the Ameri can cul ture 
and as a new profession evaluators 
needed to prove to administrators 
and other professionals, funding 
sources, and themselves that they 
really knew what they were doing. 
The presence of fancy and often 
expensive hardware gave the appearance 
of professionalism that was needed. 

3. Poor Consumer Training—For a variety 
of reasons most evaluators have 
little knowledge in the technical 
aspects of work sample develop- 
ment or research. This resulted 
in not being able to ask meaningful 
questions about the research and 
development of work sample systems 
and to fall victim to written and 
spoken claims as to their effective- 
ness. The accurate assessment 
of a client's vocational capacities 
should be the main concern of the 
evaluator; part of this respon- 
sibility is to select val Id techniques 
for use in the evaluation unit. 

Of course , commercial vocational 
evaluation system developers must 
share at least equal responsibility 
for this state of affairs. There 
are three reasons why they have not 
done the preliminary research prior 
to marketing a system: 

1. Desire for a Prof i t--Whi 1 e the 
first work sample systems were 
developed on public money, most 
of the later ones were developed 



on a combination of public and 
private funds, or entirely on 
private funding. To my knowledge, 
ell present systems must make 
a profit to survive. Because 
research costs money and lengthens 
the time between development and 
release to the public, there is 
a desire to cut costs as much 
as possible, especially if the 
targeted, customers will likely 
not notice it anyway. The goal 
of a business is not to make a 
profit; it is to provide a useful 
product or service that in turn 
will be prof itabl e. Somewhere 
the "useful product or service" 
was misplaced. 

2. Sel f-Decei t--The first reason 
assumes a rational decision not 
to devel op a good product because 
of time and cost considerations . 
From my personal experiences of 
working with many developers over 
the years, I am of the opinion 
that many real ly bel ieved that 
they were developing a good product 
and did not have to perform research. 

3. State of the Art—Most work samples 
were not thoroughly researched 
prior to release because it was 
(and still is) the covertly accepted 
practice to sell and use instruments 
that were not ready for market , 
at least as finished products. 



These six are the major reasons 
why work sample systems have not 
been properly researched prior to 
sale; though there may be other reasons 
that I did not list. The problem 
is that , for whatever reason , these 
systems are a part of our daily profes- 
sional lives. They will not be recal 1 ed 
because of factory defects. My concern 
is that as the new era of short-time, 
computer based assessment tool s arrives , 
these new products wil 1 repeat the 
same mistakes of the past and eval uators 
will purchase them with the same 
hope and enthusiasm that they purchased 
other products ten years ago. In 
the end the client loses. 
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What Can Be Done 

I would like to offer some solutions 
to this problem. Any solutions must 
be realistic and we must realize that 
a free market place will continue 
to operate without major outside influ- 
ences. I do not see any governmental 
influence providing consumer protection 
for either evaluators or their clients. 
I also doubt if any professional organi- 
zation, such as VEWAA, will take the 
lead in developing a set of standards 
as tough as the American Psychological 
Association's Standards for Educational 
and Psychological Tests (APA, et al . , 
1974). Even if standards were developed 
they would not be enforced. The CARF 
vocational evaluation standards for 
work samples are not enforced and 
there is no reason to think that others 
would be enforced. The solutions 
will depend on both users and developers. 
Evaluators can do the following: 

1. Become Knowl edgeable— Before purchasing 
a work sample or any other assessment 
device, the e valuator should carefully 
read the manual , ask for technical 
reports, and subject this information 
to a critical review. If an eval uator 
is not knowledgeable in the technical 
aspects of test and work sample 
development, he/she should attempt 
to take a college course in psycho- 
metrics or testing. The best way 
to get developers to improve a 
product is to stop purchasing it 
and then to tell the sales represen- 
tative why. 

2. Consider Other Techni ques--Work 
sample systems are not the only 
methods of evaluation. Before 
purchasing a work sample system, 
see if other methods will work 
just as we 11 and cost less. In 
the last five years, for example, 
many psychological tests have been 
developed or modified for disabled 
persons. More workshops are having 
success with job site placement. 
The eval uator should consider other 
techniques . 

3. Realize That There Are No Easy 
Answers--Eval uators must realize 



that they have a very difficult 
job and that there are no easy 
answers. We are conditioned to 
expect instant answers, especially 
ones offered under the guise of 
high technology. The reality 
is that there is no single product 
that will assess all disabled 
persons; some will work for some 
and not for others . 

4. Avoid Flash--0ne of the best selling 
features of work sample systems 
is that they use audiovisual and, 
more recently, computer technology 
to produce highly interesting 
and impressionable displays. 
These 1 ook good in the eval uation 
unit and impress cl ients and visitors. 
While techncl ogi cal answers are 
very useful in some cases, the 
eval uator shoul d 1 ook for content 
behind the flash. Does that computer 
administered test really measure 
some tra i t more accurately than 
a standard test or is it just 
more attractive? It certainly 
costs more. People in AA have 
a saying: "keep it simple"; may 
be we should follow this. 

5. Set the S pe ci f i ca t i ons-- I f it 
is decided that the eval uation 
unit needs a new method to assess 
a particular skill, trait, etc., 
that unit should set the standards. 
The guidelines given in Botterbusch 
(1980) could be followed: consider 
the community, cl ient popul at ion, 
purpose of evaluation and the 
use of other techniques deciding 
if a new eval uation system shoul d 
be purchased. 

Devel opers of work sampl e and 
assessment systems could do the following: 
1. Enlightened Sel f- i nterest--Qui te 
simpl y stated , a better product 
shoul d resul t in increased sal es 
and increased use. If a company 
i n tends to stay in business over 
the long run, it's chances are 
increased if they produce a durable 
product and begin to buil d a reputation 
on that product and, hence, on 
the company name. A sol idly developed 
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product with an ongoing research 
program is a sound, if long term, 
investment. 

2. Invest in Research—Research must 
be done as an attempt to improve 
a product prior to initial sale 
and over the lifetime of that product. 
Research must not be confused with 
adverti si ng and adverti sing must 
not replace research. Developers 
should also realize that validation 
is not a one-shot study with a 
small group of subjects in one 
parti cul ar faci 1 i ty . Devel opers 
need to establish research programs 
and to publish whatever the results 
are in professional journals. 
They should make provisions for 
cooperative studies with facilities 
and universities willing to perform 
unbiased research. Validation 
and acceptance wil 1 not come overnight. 

3. Users Less Naive—Some professionals 
have been in the field for several 
years and have seen the rapid ascent 
and subsequent decl ine in the popularity 
of work sample systems. More new 
persons entering the field are 
better educated and more able to 
ask questi ons about reliability 
and validity than they once were. 
One recent and encouraging example 
of this is the detailed critical 
analyses of norms for the Valpar 
17 (Nicholson, et al., 1984). 

In conclusion, consider your 
clients a.;d act as their advocates. 
The wcrst possible case to imagine 
is a class action suit against a state 
agency or facility for making vocational 
decisions on the basi s of devi ces 
poorly normed, having unknown rel iabil ity 
and unknown validity. What defense 
could any of us offer? 
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RESEARCH NEED IN VOCATIONAL ASSESSMENT 



FREDRICK E. MENZ 



ABSTRACT: In the course of this paper, 
a perspective is offered regarding 
the value, contributions and needs 
for research on vocational assessment 
or evaluation. Fundamental professional 
and research issues are traced from 
their origins in the 1960s to set 
the tone for a review of the research 
priorities which have been addressed 
in the literature since that time. 
Following a review of the quantity 
and quality of research that has been 
undertaken between I960 and 1980 is 
a discussion of some major public 
policy changes, social trends, tech- 
nological advancements and population 
dynamics which can be expected to 
significantly affect the growth of 
the discipline and the research that 
is needed in the coming decades. 
Finally, a program of research is 
presented which attemps to maintain 
a careful balance between the field's 
need for research that leads to direct 
solutions for current problems and 
the field 1 s need for research which 
continues its development as a discipline. 
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Throughout the paper certain 
consistent terminology has been adopted. 
First, "assessment," "eval uation 
"vocational assessment" and "vocational 
eval uation" are used interchangeably 
with ful 1 recognition of the ongoi ng 
debate in the discipline over which 
term is most appropriate in vocational 
and rehabi 1 i tati on setti ngs . Second , 
the terms "assessment devices" and 
"evaluation devices" are used to 
cover the collected technology and 
instrumentation used in assessment 
to gather systematic, reliable information 
on a person's aptitudes, capacities 
and limitations, achievements, skills, 
interests and needs. Third, "cl ientele" 
and "eval uee" are used to refer to 
persons being evaluated or assessed. 

As one goes about reviewing 
the 1 iterature of this field, frustration, 
renewal and humbl e hope are three 
emoti ons that arise as one attempts 
to devel op a useful pa per on this 
topic of the rol e , val ue and need 
for research . Frustration because 
there is so much to cover under the 
topi c , so many di fferent sources 
that shoul d be checked , reviewed , 
reacted to , synthes i zed: Too many 
choices of where to begin, what to 
present and how to present it. There 
are some key works on vocational 
assessment which need to be read 
by any who are concerned with this 
topi c . In rehabi 1 i tati on , some 
of these are McCray, 1 982; Pruitt, 
1977, 1983; Dunn, et al ., 1976; Bolton, 
1972; VEWAA, 1 975; Institute on Rehabili- 
tation Services , 1 972. From the 
related disciplines of educational 
psychology, vocational education, 
special education and industrial 
education Petersen , 1981 ; Petersen 
et al., 1981; Finch and Impel 1 itteri , 
1 971 are some examples of resources 
that we each must reexamine. There 
is and will continue to be considerable 
information to be judged and summarized. 

A fair amount of transdiscipl inary 
activity has taken place since 1960 
to both define and demonstrate the 
processes , practices and technology 
used in vocational assessment. In 
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the 1960s, the debates centered on 
clarifying fundamental issues facing 
this emerging discipline, on setting 
forth a coherent philosophy of vocational 
evaluation (VEWAA, 1975; the Iowa 
Conference on Vocational and Prevocational 
Assessment, 1969) and on posing questions 
about vocational evaluation's utility. 
By the end of the 1970s we begin to 
find that a truly noticeable amount 
of research (see reviews by Berven, 
1983; Herbert and Menz, 1981; Fry, 
various years) had been undertaken 
which attempted to establ ish the val idity 
of measurement techniques and to demon- 
strate the impact of our evaluation 
practices. During this same time, 
the technology and processes of vocational 
evaluation began to be adapted and 
debated in the related fields of vocational 
education, industrial education, and 
guidance and counseling. The 1980s 
are, again, characterized by adaptation 
and debate regarding the utility of 
vocational assessment. Now, though, 
our colleagues in special education, 
in the private sector and employers, 
as they begin initiatives into company 
s ponsored re ha bi 1 i tat ion , are the 
major contenders in these d- Lates 
and adaptations. 

As one tries to develop a perspective 
from the literature of the p?$t 20 
years, one comes to realize that a 
viable body of research on vocational 
assessment has begun to dev "Up. 
Like the physical and social development 
of an infant, if one traces the disciplines 
maturation through its literature, 
we find that muscle is actually beg ... ; ng 
to replace the discipline's ba 1 : fat. 
Its cognitive processes a •? oming 
functional as it acquire* language 
fl uency : Its vocabulary (terms) , 
speech patterns (use of consistent 
definitions of processes), syntax 
(assumptions) and log:c (operational 
definitions) have become understandable 
and acceptable (according to the standards 
of research). The creature is beginning 
to be able to communicate. As rcuscle 
(knowledge derived from technically 
sound research) replaces fatty tissue 
(i.e., untenable hypotheses and supposi- 



tions , fol klore is dispelled by empiric- 
ism) , the di sci pi ine begins to make 
its first unassisted attempts at 
wal king. Motor coordination is still 
devel opi ng (val i dated and normed) , 
it still stumbl es ( i ts technol ogy 
is still not completely reliable) 
and it clearly is not ready to dance. 
But, because the results of research 
on similar problems of health have 
been conducted in rehabilitation, 
education and the private sector, 
their shared value has led to providing 
the discipline with a more balanced 
nutritional program (repl icable methods 
and research which are mul ti- perspective 
and lead to self-correction). The 
di sci p*i ine i s now begi nni ng to be 
properly nurtured. A new and healthy 
growth spurt can be expected. 

Finally, as one attempts this 
revi ew, one cannot hel p but real ize 
an inkling of val i da t ion for the 
discipline and find reminders for 
the roles there are for research 
in helping the discipline test and 
yal i date i tsel f . As I went back 
in time in the literature to reexamine 
the quantity, complexity, origins 
and history behind the key issues, 
I could not help but come away with 
a better appreciation of what the 
disci pi ine is about , with what it 
has had to deal , what has been accom- 
plished, what has not been accomplished 
and what it may never accompl ish* 
In a sense, while one can find renewal 
and validation for the discipline 
and ones potential contri but ions , 
one cannot but al so come away with 
a sense of urgency. There are still 
so many questions and positions to 
be formulated as issues, so many 
i ssues to be translated into doabl e 
research , so many i ssues to be readdressed 
as our national fabric and values 
change, so many studies to be replicated, 
and so many new topics and probl ems 
which require solutions. In the 
face of such a vast range of needs , 
one must remember the "reality testing 
tenant 11 of research in the behavioral 
sciences : Resea rch rarel y answers 
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a question in the affirmative for 
its purpose is to accumulate evidence 
regarding sides of the issues which 
surrounds any dynamic phenomena. 

Issues in the Literature 

The literature between 1960 am\ 
1 980 i s i ns tructi ve i n terms of how 
radically the discipline was moving, 
the issues which concerned our colleagues, 
as well as their valuing and priorities 
for research on evaluation or assess- 
ment. The technology used in assessment 
of disabled persons underwent a radical 
reevaluation and redevelopment. It 
was during this period of time, that 
frustration led theorists and practitioners 
of evaluation to move away from a 
total reliance on psychometric models 
and methods for assessing the impact 
of disability on the potential of 
disabled persons. The discipline 
shifted its energies into development 
of work sampling as both a theory 
and an assessment process, into develop- 
ment of reliable methods for conducting 
situational assessment, into developing 
commercial, program and disability 
specific evaluation systems, and into 
laying the groundwork for many of 
the computer-based evaluation and 
assessment systems now being offered. 

It is during this period of time 
that we found our colleagues were 
attempting to define vocational evaluation 
processes and establ ish it as a legitimate 
discipline within rehabil i tat ion. 
Issues of professionalism (Walker, 
1970; Rosenberg, 1970; Pruitt, 1970) 
and of the role and competencies needed 
by those doi ng vocational assessment 
(Genskow, 1973; Clark, 1969; Coffey, 
1978; Coffey, Hansen, Menz, Coker, 
1978; Lllien, Menz and Coffey, 1978) 
were raised as extensions of other 
fundamental di sci pi i nary concerns : 
the role of the evaluation specialist 
(Pruitt, 1970), the traditions of 
a profession (Neff , 1970; Lustig, 
1971; Nadolsky, 1971), the applications 
and utilization of evaluation results 
(Gellman and Soloff, 1976; Hoffman, 
1976) and the relationship of the 
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evaluator to other professional s 
(Clark, 1976). And, several attempts 
were made to relate how research 
should be conducted in the interest 
of the discipline (Neff, 1960, 1969, 
1970; Spergel, 1970; Overs, 1970) 
and how differing research needs 
might be sys tern a ti cal ly attacked 
(Dunn, Korn and Andrew, 1976). 

Major symposia and conferences 
provided the forums at which these 
issues were articulated. Among the 
most frequently cited are the Iowa 
Conference on prevocational and vocational 
assessment (1 960) , the invitational 
conference on new directions in rehabili- 
tation at Sinai Hospital in Baltimore 
(Smol kins and Cohen, 1971 ) , the Institute 
on Rehabilitation Services on the 
role of vocational evaluation in 
rehabilitation (1 972), the Vocational 
Evaluation and Work Adjustment Association 
project on i ssues underl yi ng theory , 
processes, and validity of vocational 
evaluation (VEWAA, 1975) and the 
conference on critical issues in 
vocational evaluation held by the 
Research and Training Center at the 
University of Wisconsin-Stout (Dunn, 
et al., 1976). Those early debates 
dealt with basic issues surround- 
ing the philosophy of vocational 
assessment, the very lan gu age of 
vocational /work eval uati on/assessment, 
whether a theory of evaluation could 
be set forth, the criteria that are 
appropriate for judging evaluation's 
worth, and the contextual, program 
and cl ient variables which enabl e 
or prevent vocational eval uati on 
(vocational assessment) from being 
effective. Many of the issues relating 
to theory, practice and professionalism 
in vocational eval uati on/assessment 
raised at those conferences have 
been responded to in other papers 
at the current Forum. There appears 
to be a rather healthy, though tentative, 
consensus about the major premises , 
terms and assumptions underlying 
the several theories of vocational 
assessment/eval uati on. We note some 
clarity and acceptance of what it 
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is that vocational assessment is trying 
to do and the variety of technology 
which can be brought to bear. It 
also appears that there are major 
professional skills issues yet to 
be resolved (e.g., who can or should 
do it, what skills are need for doing 
it in different settings, accreditation, 
credential ing, 1 i censure) . Collectively, 
these issues and the tentative resolu- 
tions we find in the literature should 
be kept in mind as we try to explain 
accomplishments of the field in response 
to our past research priorities. 
The narrowness of the issues dealt 
with in vocational assessment/evaluation's 
research and generally low level of 
scientific quality of research conducted 
during the 1960s and 1970s is partially 
explained by the turmoil faced by 
the field and, in no small way, is 
related to how the field, at that 
time, valued research. 

Rosenberg (1970) characterized 
the direct approach generally ascribed 
to by the field in how practitioners 
adopt, install and accept a particular 
evaluation technique or system. 

Rehabilitation agencies have 
had a tendency to develop vocational 
eval uation programs from inadequate 
i nf ormation obtai ned from staff 
members setti ng up these programs , 
patterning their programs around 
agencies running evaluation units, 
and duplicating programs described 
in the professional literature. 
It is a remarkable accomplishment 
that rehabi 1 i tat ion agencies have 
developed so many outstanding vocational 
eval uation programs without the 
benef i t of sci enti f i c and tested 
methods. (Rosenberg, 1970, p. 30) 

While Rosenberg expressed cynicism 
a bout how programs come about , in 
spite of themsel ves , without the guidance 
of sound research, Spergel was acerbic 
in his judgement of eval uation 1 s disciples 
of the 1 960s. He "challenged them" 
for their aspirations of d i s c i pi i na ry 
acceptance , whil e they denegated research, 
and for their penchant to accept or 



reject a technique or practice based 
on limited evidence. Dunn (1976) 
was to later refer to this as a kind 
of product sanctioning or product 
eval uation using "presumptive val idity. 1 ' 

While research is defined 
as a ... systemati c , detai 1 ed , 
and rel ati vely prolonged attempt 
to discover or confirm the facts 
that bear upon a certain problem 
or probl ems and the 1 aws or pri nci pi es 
that govern it .... (and) the 
essence of the concept seems to 
e scape the f i el d of vocati onal 
eval uation. 

(The) rational izations, denials, 
pedant i c i ntel 1 ectual izations , 
and projections of work evaluators 
... must be recognized for what 
they are: pure (but not simpl e) 
defense mechanisms to sustain 
their vested interests and justify 
t hei r existence . (Spergel , 1 970, 
P. 21) 

Walker (1 970), in a less than 
well cited paper, built a meaningful 
case for those i n the then emergi ng 
profession or discipline of vocational 
eval uation to develop the tradition 
among pract i ti oners for conducting 
and incorporating the results of 
research in practice. Like Spergel , 
he saw research as an imperative 
tool. Unlike Spergel, though, Walker 
brought the chal 1 enge home to the 
practicing evaluator; to the level 
of pressing him or her with the prospect 
of obsol escence . Wal ker warned that 
the f i el d of vocati onal eval uation 
coul d destroy i ts gai ns and val ue 
if it imi tated other di sci pi ines 
in the be ha vi oral areas : devel op- 
ing codes and standards to perpetuate 
its position among other disciplines, 
rather than putting its energies 
into actions which will insure continued 
gains and adaptation to the needs 
presented to it. 

Tottering professional organi- 
zations share ... one common deno- 
minator whi ch has created thei r 
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current plight .... tha problem 
of responsiveness .... (Unless) 
a system is constantly responsive 
to the needs of its clientele and 
the general community, it assumes 
a posture which could at best be 
descri bed as i rrel evant . Fi el ds 
become irrelevant because they 
fail to develop a feedback system 
which narrows the gap between what 
they are and what they ought to 
be. 

In spite of some early warning 
signs that vocationa evaluation 
is already suffering from early 
senescence, it can , by viewing 
other tottering systems (social 
work, psychology, psychiatry, speech 
pathology), prevent the cancerous 
growth of irrelevance. Rather 
than adopt the popular cocoon model , 
it can develop a system of feedback 
which may produce its share of 
discomfort but which can also insure 
that the field is capable of effectively 
responding to those it serves." 
(Walker, 1 970, p. 39) 

Consequently, the focus in debate 
came to whether meaningful research 
could actually be conducted on vocational 
assessment and, if so, which issuer, 
were of highest priority. Spergel 
(1970) bel ieved that "... work evaluation, 
operationally defined, whether it 
be classical psychological testing, 
job analysis, work samples, the situa- 
tional or work adjustment approach 
... or job try-outs ... lends itself 
to reasonably well-designed experimen- 
tation." That adequate research is 
not being done, he might argue, relates 
more to the di sci pi i nes not accepti ng 
this ar> fact, than it does to whether 
it can be conducted. Overs (1 970) 
believed that significant parts of 
the problem of doing useful research 
on evaluation were rooted in the disci- 
pline's failure to share research 
in the usually accepted ways (via 
journal s or wi del y di stri buted reporting) , 
its not building upon previous research 
(no one ever cited anyone else), its 
use of naive research methods and 
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its tendency to either too narrowly 
or too expansively consider the scope 
of their research questions. 

Neff's (1960, 1970) observations 
on scientific methods were reminders 
whi ch pi aced much of what coul d be 
done in research on vocational eval uation 
into perspective. He provides the 
reminder that, regardless of the 
discipline, there are three underlying 
principles governing scientific inquiry: 
(1) controlled observation and reporting 
of the results of our inquiry, (2) 
underlying predictabil ity of events 
and oehaviors as a basis for establ ishing 
1 aws or pr i nci pi es , and (3) val id 
techniques for recording Measuring) 
the significant occurrences of non-trivial 
events and behaviors. Failure to 
incorporate these as considerations 
when conducting field research yields 
research which cannot hel p but be 
shallow and lacking in any meaningful 
contributions to the discipline. 

Neff (1960, 1970), Spergel (1970) 
and Overs (1970) were not just critical 
of practicing eval ua tors , faulting 
them for thei r non-rel iance on the 
wisdom and veracities which research 
produces. Each was an active, productive 
researcher trying to sol ve the very 
pro bl ems they were raising among 
their practicing and academic colleagues. 
Neff offered research priori ties 
which were both pragmatic and methodo- 
logical, ones which are fundamental 
topics of concern in eval uative research: 
Who do we serve, how effective are 
our evaluation procedures and what 
methodologies are most effective 
in researching behaviors and validity 
of evaluation practices. 

The nature of Neff's priorities 
attempted to point out needs for 
completeness, depth, accuracy and 
general izabil ity of research on evaluation 
procedures to the disci pi i ne . Neff 1 s 
emphasis on "targets of our programs," 
was a concern with more accurately 
defining groups on the basis of the 
functional limitations (broadly conceived) 
of persons compri si ng our targets , 
instead of relying on such a simple 
classification trait as "type of 
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disability." As he viewed the need 
to determine program effectiveness, 
his point was that we should design 
studies which fully examine a meaningful 
set of contributors to program effects 
against viable criteria of program 
effects. His emphasis on need to 
improve evaluative research methods 
was a recognition that selection and 
measurement of success criteria are 
fundamental problems which must be 
solved. As follow-up studies are 
integral to conducting appropriate 
controlled studies of effect, improved 
procedures are needed for selection 
of representative samples, determining 
appropriate interval and frequency 
of follow-up, locating subjects for 
follow-up, structuring inquiry and 
data collection during follow-up and 
accounti ng for the i nf 1 uence of fol 1 ow-up 
on observed findings. 

Studies of effect and efficiency 
would be more valuable if they reliably 
related contextual (e.g., availability 
of community resource , famil ial support) , 
process (e.g., staff cohesiveness 
and competence, data used in decision- 
making, as well as program structure) 
and person (e.g. , functional 1 imitations , 
work history, attitudes) variables 
both to simple criteria (e.g., time 
to accomplish an outcome, utility 
of assessment reports, successful 
closure) and to complex criteria (e.g., 
indicators of in-process immediate 
and long-terms effects, impact on 
vocational decision-making, and direct, 
indirect and cumulative effects on 
rehabilitation). From such studies, 
Neff suggested, we would not only 
gain evidence documenting the predict- 
ability and efficiency of our methods 
and more exacting definitions of what 
the technology of vocational assessment 
is comprised, but also a more complete 
knowledge of with whom and with what 
resources such resul ts can be realistically 
assured. 

The i ssues and priorities which 
Spergel (1970) identified pointed 
the field toward research priorities 
quite different from those identified 
by Neff. While Neff's pointed out 
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research needs focused on the evaluation 
of program effects and efficiency, 
Spergel 's seemingly specific topical 
priorities pointed to needs for careful 
inspection and testing of the foundations 
of the vocational assessment and 
evaluation processes used in the 
field. Spergel saw needs for research 
which specifically judged the soundness 
of the assumptions upon which eval uation 
systems and assessment devices were 
developed (e.g., the di scriminant 
val i di ty of the Data-Peopl e-Things 
cl assi f i cati on upon whi ch several 
commerci al eval uati on systems were 
based), validity of the instruments 
or systems among different sub-populations 
(e.g., responses of culturally or 
f unctional ly disti net eval uees to 
i n struct ional formats , effects of 
learning during assessment, rel iabil ity 
of observed performance , appropriateness 
of norms ) , and both the predictive 
validity (e.g., response to rehabili- 
tation, correl ation of assayed capacities 
with training outcomes or career 
achievement) and concurrent validity 
(e.g., physiological correlates during 
work sample performance, inter- system/test 
correl ation ) of speci fic eval uation 
measures . 

Genskow (1973) and Brolin (1 973) 
were among those who laid the early 
groundwork for the research needs 
identified as most critical for vocational 
evaluation at the University of Wiscon- 
sin-Stout Research and Training Center 
i nvi tat ional Conference on Critical 
Issues in Vocational Evaluation (Dunn 
et al ., 1976). Habil i tation or rehabili- 
tation is generally accepted as the 
ultimate, long-term criterion for 
educati onal , medical and vocational 
rehabi 1 i tat ion pract i ces . However, 
we find little agreement in vocational 
assessment research as to what coul d 
be the optimal predi ctors of such 
a criteria. From a research point 
of view, this is known as the "predictor 
issue," the joint problems of identifying 
independent variables and of selecting 
appropriate measures or indexes which 
may predi ct eventual habi 1 i tation 
or nonhabi 1 itati on among di f ferent 
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people in vocational assessment. 
For the practice of assessment, this 
predictor issue means that we cannot 
reliably estimate whether different 
evaluees are more or less likely of 
becoming habilitated or rehabilitated. 

Genskow, in talking about the 
i mportance of the "eval uator as a 
synthesizer" of information, offered 
the field a unique way of viewing 
the eval uator as a professional, and 
may have fostered a trend in vocational 
evaluation research which is yet to 
be realized; consideration of assessment 
as a complex activity in which the 
use of testing/assessment technology 
is only one part. Strictly defined, 
evaluation is a process for gathering 
information upon which some set of 
recommendations can be validly based. 
Under Genskow's conceptualization 
of the eval uator as a "synthesizer," 
information gathering, using specific 
techniques (tests , work samples, systematic 
observation), is one of several sub- 
processes, among which interpretation, 
sharing and responding to evaluative 
results on the part of eval uator and 
evaluee may be of equal significance 
in terms of their contributions to 
the impact of an individual ' s evaluation. 
This type of reasoning opened a direction 
for research which conceived evaluation 
as a "synthesizing process," in which 
the specific technologies and processes 
combine and become part if the predictor 
issue, a complex predictor of an evaluee's 
potential for successful habil itation. 

Brolin (1973) not only raised 
issues of when and how evaluation 
should be used in the rehabilitation 
of disabled persons, but offered the 
field a most pragmatic summary of 
the real research issue that those 
conducting any assessment process 
(psychol ogi cal , personnel , physical , 
work, vocational) must resolve; the 
issue of the val idity of the individually 
derived vocational evaluations. 

(The) ... field of vocational 
eval uati on appears to be exi sting 
without a systematic body of knowledge 
(because) the evaluator approaches 
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his job in an a priori way, i.e., 
assuming that whit he is doing 
is reasonable er»d self- evident 
.... I take the position that 
a scientific approach is needed 
i f vocational eval uati on i s goi ng 
to have any degree of val idity 
... and has the characteristic 
which is the hallmark of the scientific 
method, sel f-correction." (Brol in, 
1973) 

The Conference on Critical Issues 
al so brought together much of the 
thinking and research literature 
respective to needs in vocational 
evaluation. In particular , the conference 
focused the concerns of the field 
on fundamental professional and research 
i ssues : Fundamental technical issues 
respective to the tools and tech- 
nologies used by evaluators and funda- 
mental pro gramma ti c i ssues related 
to the quality, value, impact and 
et hi cs/ professional ism of vocational 
evaluation: In their summary of 
the proceedings and outcomes of that 
conference Dunn and his col 1 eagues 
(Dunn et al . , 1 976) elaborate and 
discuss the various sides of the 
two classes of issues. Of the two 
types of issues, clearly more serious 
needs for research were seen with 
technology of evaluation. Considerable 
research was found to be needed which 
woul d yield evidence as to the reliability 
(e.g. , retest rel iabil ity of performance 
on work samples, inter-observer reli- 
ability for situational assessments, 
internal consi stency in interest 
scales) and validity (e.g., prediction 
of training outcomes , concurrent 
validity in terms of industrial norms) 
of the work samples, situational 
assessment approaches and tests most 
widely used with special populations. 
Considerable discussion was also 
given to the responsibilities of 
developer and user in establishing 
rel iabil i ty , val idity and norms; 
to whether a psychometric model or 
some other model should be the basis 
for establ ishing evaluative rel iabil ity 
and validity; to the need for practi- 
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tioners to accept the concepts of 
reliability and validity; and to which 
type of norm is most appropriate (client, 
student, industrial). Some of the 
programmatic research needs were to 
determine with whom vocational eval uation 
was effective, determine the role 
and function of evaluator and evaluee 
in evaluation decision-making, determine 
the effectiveness of different evaluation 
methods and determine the role and 
function of the vocational evaluator. 

Reviews of Research 

A review of the research literature 
on therapeutic effects of vocational 
evaluation was conducted by Herbert 
and Menz (1981) to see whether there 
were general izabl e themes regarding 
what evaluation does to people who 
go through it (as opposed to what 
i nformation they acquire) . As proponents 
of the hypothesis that any process 
in which humans are active participants 
will have measurable (preferred or 
not) effects, the reviewers sought 
to find out whether their shared expec- 
tations were borne out in the literature. 
Herbert and Menz found a generally 
inconclusive body of research. They 
found neither support for their basic 
hypothesis nor evidence sufficiently 
convincing that a null hypothesis 
was more tenable. As Neff and others 
had found, much of the research was 
narrow in its conceptualization, clearly 
flawed and naive. Their concluding 
reactions were ones of dismay that 
the approaches used so often stressed 
practicality ^o the extent that the 
very attempts to apply basic research 
results to practice quite often destroyed 
either the credible general izabil ity 
of the knowledge derived from the 
research or aborted a perfectly good 
piece of "new knowledge." Most of 
their recommendations focused on use 
of research methods , as suggestions 
to improve the likelihood that research 
findings could be accumulated. In 
particular, they noted the needs to 
more accurately define dependent and 
independent variables, to use varied 
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kinds of research designs, to conduct 
replication studies, to incorporate 
mul t i -cri teria and mul ti -measures 
within the research design, to be 
innovative in methods used to solicit 
information or measures of processes 
and results, to establish consistency 
in data col 1 ec ted inter- study, and 
to report research findings in profes- 
sional journals and resposi tories. 

Berven conducted a survey review 
of the vocational assessment literature 
for the National Rehabilitation Infor- 
mation Center (Berven, 1983) and 
more broadly considered the problems 
and accompl i shments of research on 
assessment than did Herbert and Menz. 
Included in Berven's review were 
281 of over 500 documents available 
in journal s , as books , and in the 
various retrieval system generally 
accessed by practitioners and researchers 
in vocational assessment (e.g., ERIC, 
NARIC, REHABDATA, The Materials Develop- 
ment Center at the Uni versi ty of 
Wisconsin-Stout). The 281 documents 
fel 1 i nto six categori es : General 
References (7%) such as bibliographies, 
books, reviews; Instrumentation Reports 
(40%) , Hescri bi ng , documenting the 
technical characteristics and applications 
of rating scales, tests, batteries, 
work evaluation systems and observation 
systems ; Program Reports (19%) , 
describing assessment programs, their 
goal s , appl i cations and occasionally 
outcomes; Predictive Research (9%), 
reporting on validity of predictions 
and recommendations and effects of 
eval uation on cl ient and counselor 
behavior; Research on Competing Var iables 
(2%), reporting on factors wTncK 
influence cl ient performance in vocational 
assessment, such as test-taking condi- 
tions, evaluator behaviors, and client 
characteristics or behaviors as influ- 
ences; and Deci sion-maki ng Research 
(1%) , reporti ng on decision-making 
behaviors of clients, evaluators 
and counselors. 

As the 1 argest category of documents 
included dealt with "instrumentation," 
Berven commended what research there 
wa s for i ts attempt to establ i sh 
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cri terion-rel a ted val idity. Still , 
he concluded, "In general, research 
on reliability and validity of instru- 
mentation has been limited, and there 
is consequently little empirical basis 
for instruments and systems commonly 
used in vocational assessment." (Berven, 
1 983 , p . 1) As is evidenced above , 
in terms of the extent and quality 
of research reported in those documents, 
Berven drew the following conclusion 
regarding the evidence in support 
of vocational assessment: 

Despite the vast amount of 
literature available on vocational 
assessment, empirical research 
in this area has been quite limited. 
Of the many documents which report 
on instrumentation and assessment 
programs .... the empirical basis 
underlying many of these instruments 
and programs is lacking. Consequently, 
in using commercial vocational 
assessment systems , rehabil i tat ion 
professionals often have no assurance 
that performance in assessment 
has any relation whatsoever to 
employment potential. Similarly, 
in virtually every category of 
documents reviewed, research evidence 
is insufficient to draw conclusions 
with any great degree of confidence." 
(Berven, 1983, p. 4) 

As a result of his review Berven 
identified six types of needed research. 
In many respects these needs are a 
reflected extension of that which 
Neff, Overs, Dunn, Brolin, Genskow, 
Spergel and the casts of thousands 
posed in the 1 960s and 1 970s. in 
some respects, too, they represent 
unfinished tasks of a discipline ir: 
the process of growing. Research 
i n assessment are needed to establ ish 
competitive or industrial norms for 
commonly used devices; establish reli- 
ability (especially inter-rater, test- 
retest) and val idity (1 ong-term predictive 
and of professional observations) 
of common 1 y used de vi ces; determi ne 
impact of non-standard a^mi ni strati on 
of standardized instruments (e.g., 



adapted tests for functionally limited 
persons); document value of assessment 
against multiple criteria; determine 
how person, test condition and profes- 
sional practi ces i nf 1 uence i ndi vi dual 
performance ; and determine cl inical 
judgement and decision-making strategies 
used in evaluation. 

Both reviews reflect a continuing 
probl em wi th vocati ortal assessment 
research. While, the application 
of research methodology in assessment 
research has improved over the years, 
as practitioners have had better 
training in professional practice 
and research skill areas and as technical 
support for doing research on assessment 
has improved, the inconsistency with 
which adequat3 methods are followed 
still seriously hinders the field 
in its assimilation, integration 
and proffering of empirically determined 
underlying eval uati on pri nci pi es • 
Fortunately, there are beginning 
to be substantive exceptions to this 
finding. The research on the effects 
of assessment on vocational attitude 
can probably be accumulated and synthe- 
sized. The body of research on the 
McCarron-Dial could probably be brought 
together to begin to define its basic 
structures and construct validity. 

Contexts of Research Needs 

The professional and research 
1 i terature on vocational assessment 
processes provides one valuable source 
of understanding of the major issues 
with which the field is or needs 
to deal . Advancements and research 
in vocational assessment are most 
often, thou-jh, reactive products; 
the disciplined ; esponse to perceived 
political, social, technological 
and economic trends and pressures. 
New populations (e.g., learning disabled, 
cul tural ly disadvantaged, close- head 
injured) are addressed in assessment 
servi ce and studi ed in research as 
pol itical and funding priorities 
redefined because of pressures applied 
by advocates for that population. 
Eval uation technology and processes 
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are developed or reconfigured to meet 
the need. Research is conducted to 
determine whether such configurations 
are appropriate. A major technological 
development in such an area as micro- 
computers promotes a host of new priorities 
and appl ications based on that technology. 
Assessment processes are enhanced 
so that evaluees with a potential 
for this expanding employment market 
can be identified and properly trained. 
New evaluation systems are developed 
in a microprocessor environment and 
marketed. Research is conducted to 
determine the validity of the enhanced 
assessment tools or the utility and 
impact of the new systems on habil itation. 
As we go about posi ng directions for 
vocational assessment processes and, 
consequently, specific issues of concern 
for assessment research, we must remain 
cogni zant of the fact that vocational 
assessment is the result of and does 
take place in a broadly based context. 
Whether we are conceiving a newer 
way to deliver our technology or we 
are conceiving the questions which 
drive our design of research, it is 
of considerable value if we have a 
feeling for how some of the major 
forces can drive or restrict the value 
of our efforts. Among the many possible 
sources which may influence our efforts, 
I find that refocusing of work that 
is occurring in the American economy, 
political and social changes which 
are beginning to reshape rehabili- 
tation and educational processes, 
changes in the demography of our national 
population (and particularly our urban 
popul ations) , and changes in the capacity 
of our current social service industry 
to meet the specialized assessment 
and habil itation needs of significant 
segments of our population are most 
prominent. How each of these four 
shape vocational assessment processes 
and determine timely research issues 
are discussed in this section . In 
the subsequent section of this paper, 
the issues raised by these influencers 
and issues identified in the professional 
literature are brought together and 
offered as a program of research. 



Changes in Work as Influencers 

The most frequently cited influencer 
of what it is that will be focused 
upon in vocational assessment is 
the s hi ft in our i ndustri al base 
as a result of new technological 
advances and the increasing technological 
competence of formerly less techno- 
logically sophisticated nations. 
As foreign products became competitive 
in both quality and price, as the 
numbers of their producers increased, 
as more companies became multinational , 
and as trade barriers were penetrated, 
export and national markets for mainstay 
American products became progressively 
smaller. Significant numbers of 
jobs in primary i ndustri es (e.g., 
steel , automotive) and in secondary 
industries (e.g. , parts supply, con- 
struction, agri-business) disappeared, 
thereby increasing job competition 
and needs for retraining for different 
jobs to which existing skills might 
be applied. And, ar was the case 
when the integrated mi^ro-circui t 
was successfully developed and incor- 
porated into the design and production 
of business and military computers 
and, recently, microprocessors, whole 
new primary (e.g., computer manu- 
facturing) and secondary industries 
(e.g., software developers, peripheral 
suppliers) have emerged. These emergent 
industries' expanding labor force 
have significant needs for workers 
to fil 1 jobs requiring unique skills 
and aptitudes for which many displaced 
workers may not have the requisite 
aptitudes and capacities to be retrained. 

The demands cf jobs and the 
workpl ace will , of course , always 
have a considerable influence on 
on what it is that our vocational 
assessment processes concentrate. 
It is perhaps a particularly major 
influencer at this time because the 
shift in our economic base is occurring 
so rapidly that considerable trauma 
is being caused for not oniy those 
displaced from jobs and those trying 
to enter the workforce for the first 
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time, but f^r those sti 1 1 in the workforce. 

Technological advancements 
have resulted in a reordering of 
tWe labor market and posed threats 
to traditional employment in many 
occupations. More recently, the 
scarcity of sc.Tie natural resources 
and the limited availability of 
other resources have dampened the 
optimism with which Americans have 
traditionally viewed the future. 
(Berland and LeClair, 1981, p. 18) 
The skill and aptiti^e requirements 
for jobs (whether th jobs are emerging 
one' or traditional jobs) must be 
adequately and valid';, measured by 
our evaluative devices. The continuing 
challenges for both practice ana research 
is to isolate the importance of specific 
skills and aptitudes for jobs available 
in industries (locally and nationally) 
and to maintain an assessment technology 
which yields realistic retraining/job 
options for the displaced or disabled 
worker and realistic career/training 
options for the person beginning or 
returning to work. The new challenge 
will come as v:e attempt to identify 
and measure needs and social reinforcers 
which those jobs and occupations meet. 
Programming to accomplish adaptation 
to new work, particularly among displaced 
workers moving into alternative oc- 
cupations during their mid-40s and 
50s ov among growi ng mi nority populations, 
may become an especially important 
goal for rehabilitation and education 
in the next decades. Evaluation of 
potential for adaptation may, then, 
become a critical new role for vocational 
assessment ond a topic in of i tsel f 
for assessment research. 

Political and Social Change as Influencers 

Political decisions and the social 
changes which come about as a result 
of those- decisions will markedly influence 
the structure of vocational assessment 
and what research is needed. The 
potency of this influence derives 
from the justification for vocational 
assessment with disabled and special 
need? popu^tions: host vocational 



assessments are authorized or required 
by federal and state laws as part 
of a training, educational or rehabili- 
tation process and most vocational 
assessments are paid for with public 
funds (Berland & LeClair, 1981; Menz, 
1981, 1983a). When pressures created 
because of diminished and inconsistent 
publ ic funding (of rehabil i tat ion 
services) are examined, a cascading 
set of infl uences can be traced to 
how a service becomes restructured 
(Menz, 1983a). Diminished or inconsistent 
funding gives way to external forces 
determining how and what is provided 
under the rubric of a given type 
of process . For instance , the need 
to compete for 1 i mi ted publ ic funds 
and, subsequently, to survive in 
the for-profit marks c , coupl ed with 
increased buyer expectations and 
demands for documerttabl e resul ts , 
may 1 ead to configuring eval uations 
processes which are narrowly goal-based 
and prescriptively focused around 
determi ni ng retraining potential 
among a very speci f ic set of jobs . 
I ncreased i nnovati on in uval uation 
(use of novel approaches to assessment 
and an infusion of technol ogy) may 
be the positive gain for the disci pi ine. 
The negative side, though, is that 
there will little evidence to support 
the validity and impact of these 
innovations on educational or rehabili- 
tation outcomes and diminished interest 
or resources to gather the needed 
evidence . 

Social changes will play a signifi- 
cant part by s hapi ng who it is that 
is given priority and to what dimensions 
of the evaluee and the labor market 
attention is focused upon in vocational 
assessment. Four parti cul ar social 
changes that have have resulted from 
public policy decisions are identified 
by Berland ~and LeClaire (1981), for 
wh^ch how such social cMnges' can 
influence the utility and effectiveness 
of vocational assessment. First, 
the lowering of the rate of economic 
growth is expected to conti nue to 
cause employment to lag farther behind 
popul at ion growth , a 1 ower overall 
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productivity in the labor force and 
decreased public resources to provide 
for assessment and training of those 
displaced or disabled during employment. 
Second, significant health care advances 
are expected to reduce the incidence 
of some disabilities, lessen the conse- 
quences of disability for others and 
restore the functional capabilities 
of many others, resulting in an increase 
in the numbers of persons needing 
s peci al i zed e val uation for return 
and readaption to work and especially 
of those who previously would have 
been considered too severely disabled. 
Third, deinstitutional ization, in 
conjunction with improved health care, 
is also expected to increase the absol ute 
numbers of disabled persons in the 
general population, increase the numbers 
of those seeking some form of employment 
(in protected, supported, community-based 
or competitive setting) and create 
additional demands on diminishing 
public resources, resources which 
they, like other disabled persons, 
will need for skills acquisition and 
adaption as they attempt to achieve 
vocational and social integration. 
Fourth, advocacy and self determination 
of disabled persons are expected to 
become increasi ngly evident (as encouraged 
through various commissions, regulations 
on client and student rights and acces- 
sibil ity, lobbying accompl ishments, 
disability specific support groups, 
social and industrial action groups, 
and the host of special programming 
in athletics and recreation, special 
o 1 ym pi cs , i n de pendent living, and 
asserti veness training now provided 
to disabled youth and adults), not 
only evidenced by their increased 
visability in many vocational and 
social contexts , but as evi denced 
as well in their increased demands 
for equal participation in social 
and pol i tical activities and a more 
prominent voice in planning and monitoring 
thei r rehabi 1 i tati on and education . 

Because of such continuing influences, 
authors like these, expect that research 
on many social programs (of which 
vocational assessment is often an 



integral process) will become increasingly 
focused. Research will be needed 
to monitor changes in the effectiveness 
of processes as increased numbers 
and more diverse groups seek the 
programs and reduced resources are 
available for supporting them. Research 
is 1 i kely to be needed which hel ps 
justi fy the util ity of programs , 
not only in terms of their cost-effective- 
ness (e.g., wages earned relative 
to the poverty level , wage gains 
subsequent to rehabil i tati on, rates 
of return on investments of public 
and private funds in rehabilitation), 
but in terms of its societal impacts 
(e.g. , incidence of disabl ed persons 
in growth careers , parti ci pat ion 
of disabled persons in vocational , 
social and political roles). Further, 
research and development are 1 ikely 
to become more closely related. 
There will be need for research which 
aids in design, development and demon- 
stration of rehabil it?tion-habil i- 
tation-education systems which are 
likely to be more complexly integrated, 
which attempt to achieve related 
vocational ana a vocational goals, 
and which may employ state-of-the-art 
technol ogical processes and devices , 
unique staffing and resource controls 
in an effort to assure specified 
levels of effect and quality. 



Population Changes as Influencers 

The demographic composition 
of the American population, the incidence 
of disabled persons in it and the 
likelihood that its composition and 
needs will change dramatically during 
the next decades will be, perhaps, 
the most significant factor influencing 
the form and substance of vocational 
assessment. The challenges such 
population changes produce for assessment 
will have their parallels as they 
produce considerable new needs for 
research on both the validity of 
the assessment technologies and the 
ef fecti veness of the processes with 
different groups of persons. 
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According to census data (U.S. Depart- 
ment of Commerce, Bureau of the Census, 
1983), 8.9% of the American population 
between the ages of 16 and 64 years 
report a work related disability. 
Several dominant patterns are revealed 
among these 13,000,000 persons: First, 
with 61% between the ages of 45 and 
65, the current disabled population 
appears to be considerably ol der than 
the national average. Second, while 
17% of the national population are 
Black or of Spanish origin , they are 
over- represented in the disabled popu- 
lations at 22%. Third, disabled minority 
group members are less educated, are 
ethnically distributed (there are 
higher incidences of disabled Blacks 
in the south and of disabled Hispanics 
in the west), are more likely than 
their white counterparts to live in 
our inner-cities, and are more likely 
to be out of the labor force. Fourth, 
while disabled males earn 79% as much 
as a non-disabled male, disabled minority 
group males earn only 62% of that 
and disabled women aarn only 48% as 
much as non-disabled males. 

As the current disabled population 
is considerably older than the national 
average, for the majority of disabled 
persons, their needs are for retraining 
to reenter the labor force in modified 
or related occupations , not for developing 
original skills. For them, assessment 
systems are needed which identify 
transferable skills and aptitudes, 
retraining potential and supportive 
resources that may be needed due to 
ageing and disability (e.g., independent 
living) (Bowe, 1982). On the other 
hand, there is a significant culturally 
di stinct portion of the disabled population 
who are considerably under-employed 
and vocationally isolated. The challenges 
to the discipline to meet the needs 
among this sub-popul ation are considerable, 
the least of which is finding and 
making vocational assessment available. 
For this minority, evaluation systems 
are needed which identify skills and 
aptitudes for jobs and careers that 
are likely to yield higher earnings, 
which evaluate potential both for 



initial entry and re-entry and for 
advancement in the labor force. 
Such evaluation devices must be demon- 
strably unbiased among cul tural ly 
unique populations and, quite likely, 
val idated within a particular geographic 
region (e.g., a specific urban or 
empl oyment market) . 

U.S. census data provide an 
indicator of the prevalence of disability 
within the current national population. 
From these indicators we can derive 
a feeling* for the types of services 
that are presently needed. Data 
on replacement rates (birthrates 
versus deathrates), legal and illegal 
immi gration , popul ation mobil ity, 
s hi f ts in the i ndustri al base and 
concentration of industry used by 
demographers and futurists to estimate 
how the national population may change 
will provide indicators of how the 
disabled population is likely to 
al so change. Based on these indicators , 
we can garner ideas on how services 
may need to change in the coming 
decades. IT the projections of demo- 
graphers are anywhere near accurate , 
immigration will be the major influencer 
for our vocational assessement discipline 
and assessment research. 

Bouvier (1983) and his colleagues 
at the Institute for Demographic 
Studies , in Washington , attempt to 
trace how the nations population 
will change over the next decades 
in relation to popul ati on growth 
among devel oped and undevel oped nations . 
They project (Bouvier, 1983) that 
popul ation growth in most developed 
nations (e.g., Western Europe ) wil 1 
continue to decline over the next 
40 years, while population growth 
in less developed nations (e.g., 
Africa, South America) will continue 
to increase during the same period. 
Unlike most other developed nations, 
and despite the birthrate among native 
Americans (second and third generation 
citizens) dropping to si igSitly less 
than its re pi a cement rat'j , Bouvier 
(1983) estimates that U. S. population 
will actually grow si gni f icantly 
during this period, due almost exclusively 
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to legal and illegal immigration. 
By 2020, Bouvier projects that all 
population growth will be a result 
of immigration. 

While immigration has historically 
been from northwest and southeast 
European countries, only 6% of the 
new immigrants are expected to come 
from these national groups. Immigrations 
from 1 ess developed Asian , South American, 
Latin American and underdeveloped 
African nations are expected to account 
for 80% of all new entrants to the 
American population. These immigrants 
are likely to be in their child bearing 
years, have higher birthrates than 
the native Americans, have fewer trans- 
fer a bl e skills and bring distinctive 
languages, values and cultural identity. 
With immigration taking place at a 
rate of 600,000 per year (legal entrants 
only), Bouvier projects that by 2030 
20% of our population may be composed 
of minority or first generation immigrants 
and 40% by 2084. 

Anneson (1984) describes an increasing 
role for minorities, and particularly 
minorities resul ting from such immigration, 
in shaping the labor market as our 
economic base shifts from heavy manu- 
facturing (steel , automotive, agricultural 
and industrial machinery) to an information 
and service industry (e.g., computers, 
bio-engineeri ng, i ndus trial processes , 
consumer products, recreation). He 
notes that immigration is not evenly 
geographically dispersed, but instead 
is regionalized, based around particular 
countries of origin. As immigration 
to these regions continues, Anneson 
projects that not only does the language, 
values and culture within that sector 
become increasi ngly si mil ar to that 
of the countries of origin, but that 
the market focus of the industry in 
such regions also becomes focused. 
Anneson sees this as particularly 
possi bl e in an economy movi ng from 
heavy manuf acturi ng and mar keti ng 
toward an economy based on information 
and services, for which capital outlay 
to develop and market products is 
considerably lower. 



Anneson's estimates are that 
70% of jobs will be in this information 
and service industry, 80% will be 
with companies not yet founded, 66% 
will be in companies employing less 
than 20 people and 33% of those new 
companies will be owned and operated 
by minority group members by the 
end of the 1980s. Marketing by these 
emerging industries in specific regions 
of the country, Anneson notes, becomes 
increasingly directed toward the 
countries of origin from which there 
has been the greatest influx of immi- 
grants, rather than toward markets 
within the United States. For example, 
Florida is becoming increasingly 
focused on the cul ture and product 
needs of the Carribean basin countries, 
industries in the south central and 
southwestern states are focusing 
on the markets and becoming increasingly 
dependent on the economies of Mexico 
and other Latin Ameri can nations, 
and industries in California are 
increasingly marketing their products 
to Asiatic countries. The new minorities 
are expected to represent a domi nant 
force in the labor market and assume 
not only a considerable voice in 
labor, but in determining management 
and personnel requirements as well. 

What these data suggest is that 
we will become a nation of 300 million 
which is multi-lingual, multi-cultural 
and mul ti-val ued. Popul ation centers 
are expected to i ncreasi ngl y ref 1 ect 
the languages, values and cultures 
of the new i mm i grants 1 nations of 
origin. Too, a shift in power and 
inf 1 uence on how the 1 abor market 
is shaped is expected, in which the 
influence of languages and different 
cultural values and ethics are reflected 
in the work environment and in the 
pri ori ties which emergi ng i ndus tries 
select for their products, services 
and markets; a shift not terribly 
unlike that which occurred as a result 
of the large scale immigration during 
the late 19th century. 

While advances in medical science 
and rehabilitation will likely prevent 
many functional di sabi 1 i ti es which 
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originate during pregnancy and childhood, 
it is questionable whether these advances 
will be readily available to signifi- 
cant portions of the immigrant population. 
Because immigrants, as a group, are 
more apt to enter high risk occupations 
and are less Likely to enter well- 
paying occupations which also makef* 
provision for expensive, preventive 
medical care, it is quite likely that 
we will see higher incidences of work 
related and organical ly based disabil ities 
among these groups. Many of these 
disabled persons are likely to require 
vocational assessment services that 
both identifies their potential for 
original occupational and career options 
and produces a rehabil i tat ion and 
educational pi an which not only considers 
vocational skills acquisition, but 
their needs for language and social 
development as well. Significant 
differences between their language, 
values, experiences and work ethics 
and those assumed under our habil itation/- 
rehabil itation and educational models 
will require us to reevaluate the 
validity of our assessment processes 
and, quite likely, devise assessment 
processes which are equally effective 
with these groups. 

Research will be needed which 
promotes the provision of vocational 
assessment consistent with the needs 
of all major segments of our population. 
First, research will be needed which 
provides norms and standards for popular 
evaluation instruments for both the 
dominant labor populations and for 
local culturally distinct populations. 
Second, research will be needed to 
determine and hel p el iminate instructional 
and contextual bias in evaluation 
procedures which are unfairly discriminate 
among minority groups. Third, research 
will be needed which will establish 
the validity of evaluation instruments 
for i denti fying aptitudes and skills 
of cul tural ly di sti net groups which 
are developable or transferable between 
jobs. Research will be needed which 
will determine the effectiveness of 
vocational assessment i nstruments 
and systems among such regionally 



specific populations as aging workers, 
disabled women , speci fic current 
minority groups and new minorities 
comi ng about due to i ncreased immi- 
gration . Research will be needed 
which will insure that affordable 
vocational assessment is available 
where those in need are located and 
which assesses not only dimensions 
of the person which are directly 
related to accessing employment (e.g., 
aptitudes, vocational and job skills), 
but dimensions which are instrumental 
i n conti nuance i n empl oyment , career 
advancement and integration into 
the larger vocational and social 
contexts of society (e.g., cultural 
and adaptive needs, needs related 
to agi ng) . 

Capacity of Services Providers 
as Influencers 

Currently, the greatest numbers 
of vocational evaluations are provided 
to persons with disabilities or special 
needs under the auspices of state 
health, education, labor and welfare 
agencies (notably through state vocational 
rehabi 1 i tati on di vi sions of social 
service programs) or through adjunct 
services of educational institutions . 
Vocationally oriented assessments 
provided for special needs students 
by secondary and post secondary school s , 
institutes and training centers prin- 
cipally reach a pre- and initial 
career entry age populations. As 
adjunct services, though, they are 
not consistently available in urban 
setti ngs (where the largest numbers 
of disabled, under em pi oyed persons 
and immigrants live) and are rarely 
available in rural settings (where 
geography severely restricts access 
to comprehensive services for the 
rural di sabl ed and under em pi oyed) . 
As the utility and importance of 
vocationally oriented assessment 
services become better understood 
and part of the diagnostics and planning 
of student education and traini ng , 
we can expect that these services 
will become more consistently available 
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to adults, as well as school age students, 
through secondary and post secondary 
institutions, especially in urban 
settings. Increasingly, forms of 
vocational assessment are being introduced 
in settings such as public and private 
employment agencies, as part of disability 
adjudication by private insurance 
rehabilitation practiti oners, and 
by some corporations in an effort 
to retrain or outplace their displaced 
employees. At present, though, the 
major providers of vocational assessment 
services are vocational rehabil itation 
facilities. Knowledge of the clientele 
to whom they are presently providing 
services tells us something about 
their capacity to serve diverse popu- 
lations. Knowledge of how they are 
expected to be staffed in the next 
decade may also tell us something 
about how they might be able to respond 
to the challenges introduced by social 
and economic changes that are expected 
to take' place during that same decade „ 

Czerlinsky and Gilbertson (1985) 
surveyed facilities, accredited by 
the Commission on Accreditation of 
Rehabilitation Facilities to provide 
vocational services, to determine 
characteristics of vocational facilities 
and their clientele. First, they 
found that 83% of the facilities provide 
vocational assessment services, Second, 
86% of their clients lack formally 
developed vocational skills upon entry 
and 58% do not hold a high school 
diploma or a certificate of general 
educational development. Third, 35% 
are under 25 (in a stage of initial 
career entry), 44% are between 25 
and 40 (in a career stabilization 
stage), while only 18% are above 40 
years of age. Fourth, only 16% are 
physically disabled, while most have 
a cognitive (55%) (e.g., mental retar- 
dation ) o r psy c h o 1 o g i cal 1 y based di sa bi 1 i ty 
(21%) . Final ly, 77% are Caucasian, 
23% are members of a definable minority 
group and the majority (55%) are male. 

Data on the manpower needs of 
vocational facilities provide some 
indication of how facility programs 
are expected to grow and how they 



anticipate meeting the needs of their 
clientele. A survey conducted in 
1979 sought data on present and projected 
employment for the decade 1980-1990 
among the 10 principal types of rehabil i- 
tation professionals working in facil ities 
(Menz, 1983b). First, among the 
five fastest growing roles (rehabilitation 
counsel ing, vocational adjustment, 
placement, vocational skills development, 
vocational eval uation) administrators 
expect that there will be a more 
than two- fold increase in the numbers 
of each type of professional , a rate 
of increase rather consistent with 
expected growth in the national popu- 
lation. Second, an increase in the 
size of facilities (based upon average 
daily attendance and number of staff) 
is expected, with the concomitant 
results that a more comprehensive 
collection of services which focus 
on most aspects of vocational development 
and adaptation will be available 
in the typical facility. Third, 
the core of the facility program 
is expected to nclude vocational 
assessment and planning, skill s training 
and adaptation to work, and placement. 

While the Czerl insky and Gil bertson 
and Menz da not directly identify 

the emphases given in vocational 
assessment programs, by extrapolation 
of these data , it woul d appear that 
the vocational assessment programs 
available in vocational facilities 
are particularly equipped to work 
with a younger, white, poorly educated 
popul ation whose disabil ity restrict 
the range of vocational and social 
goal s they can expect to pursue. 
The focus in evaluation (based upon 
the predominant ages and lack of 
skills represented) appears to be 
Oil determining how aptitudes, interests, 
and primary skills might combine 
to identify a training and rehabil itation 
pi an to achieve ori gi nal occupati onal 
goals among a population in its prime 
years of employment. As a composite 
resource , while it appears that it 
is best equipped to deal with a younger, 
underempl oyed popul ati on , it appears 
that it may be least equipped to 
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provide assessments to either culturally 
distinct populations (for whom the 
obtaining of unbiased estimates of 
vocational aptitudes and needs for 
cross-cultural adaptation are the 
issues) or plder populations (for 
whom transfer r bf skills and retraining 
is more the issue than identification 
of original aptitudes and careers). 
Growth in these programs in the coming 
decade is expected to be consistent 
with the increased number of disabled 
persons and become increasingly comprehen- 
siveness such that assessment and 
training will be more closely aligned 
and related to planned for competitive 
employment. As a primary resource, 
how this resource evolves and adapts 
as well to changes in population and 
responds to technologically determined 
needs might result in priorities for 
research focused on the comparative 
val idity, util ity and impact of assessment 
programs sponsored by such non- traditional 
groups as the mil itary, private industry, 
i nsurance companies , job-corp-type 
program and community action groups, 
as well as traditional school-based, 
facility-based and health care-based 
setting in the coming decades. 

Needs for Research in 
Vocational Assessment: A Program 

As the professional and research 
1 iterature were reviewed and the relation- 
ships of social, economic and political 
trends examined for their potential 
impact on the discipline of vocational 
assessment, one should be reminded 
that the maturity of the discipline 
can be measured by its ability to 
be self- correcting (Brolin, 1973) 
and that utilization of sound research 
on practice is our best resource for 
keeping the discipline credible: 
Research should provide us with knowledge 
about what it is we try to do, provide 
us with knowledge about how well we 
do it, provide us with the bases for 
development of new, better devices, 
technologies and processes, guide 
us as we develop relevant, dynamic 
empirical models and provide the foun- 



dations for developing a functional 
theory of vocational assessment. 
The general needs for research will 
always remain. It is only the specific 
topics which change as the sophistication 
of the discipline evolves in relation 
to its broader soci etal context . 
I find that we must encourage a broad 
range of research through organizational 
standards, collegial support, funding, 
professional activities and dissemi nation 
practices. A classification of seven 
types of research is suggested: 
Descriptive research, research synthesis, 
operations research, foundations 
research, inferential research, research 
on professional issues, and topical 
research. Specific examples of issues 
or research needs are al so provided 
for each classification of research. 

Descriptive Research 

The goal of descriptive research 
is to provide accurate documentation 
for prominent examples of what it 
is that we consider vocational assessment/ - 
evaluation. Descriptive research 
can take on many forms, but in each 
case, its intent is to document. 
Greatest value is accrued, of course, 
when there is a cleat link between 
the part or process described and 
a particular model or theory, but 
as often as not, such descriptive 
efforts provide the substance upon 
which models and theories are posed. 
1. Program descriptions. A 
particularly useful form 
of descriptive research is 
a study which yields a formal 
program specific descrip- 
tion. These researches are 
useful at a the program level 
as they provide on-going 
information about what precisely 
takes place in assessment, 
the changing characteristics 
of persons "treated," the 
conditions under which the 
assessment takes pi ace , staffing 
character i st ics, typical 
and a typical flow and sequence 
of experiences, resources 
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needed or consumed, technology 
used and changes in outcomes 
achieved under the program. 

2. Case studies. In a case study, 
significant features of a 
process are related to differential 
outcomes among a specific 
group of persons or set of 
events. For i nstance , a case 
study might be a documented 
analysis of needs, problems 
and adaptations an evil uation 
center made to a set of eval uation 
de vi ces i n order to eval uate 
four bra in- injured persons . 
Another case study might analyze 
how mandates and i ntents of 
federal legislation and guidelines 
for serving cognitively impaired 
children are responded to 
in state vocational and education 
pol icy and resource allocation 
and the extent to which those 
intents are realized in the 
programmi ng of sel ected school 
di stricts. Such case studies 
are particularly useful for 
developing the content portions 
for model practices or to 
arri ve at better definitions 
(conditional though they may 
be) of our assessment processes. 
From this research, probabl e 
independent or competing variables 
might be isolated and possibly 
confirm descriptions of models 
which may be suggested in 
theory. 

3. Historical analyses. A common 
taunt in education and rehabili- 
tation is "We a 1 ready tried 
that 20 years ago, so why 
re-invent it now?" In historical 
analyses, survey* census and 
anecdotical data are used 
to trace what has and is being 
done under the guise of assessment 
(our instruments, goals), 
where it is being done (prevalence 
in educational , commercial , 
rehabilitation settings), 
who is doing it (professional 
skill s, training) , the charac- 
ter i sti cs of the populations 



to whom it is being appl ied 
and whether these variables 
are changing in any notable 
way. The objective in this 
type of descri pti ve research 
is to maintain currency in 
our kn owl edge of practice , 
coupled with an informed 
pers pecti ve of why and of 
what it is that we are up 
to in practice. 



Research Synthesis 

Synthesis relates research findings 
to practical and theoretical models, 
helping the discipline advance its 
knowledge base. While research synthesis 
rel i es pr i nci pal ly on the research 
literature, it can draw upon a broad 
range of data sources. It both forces 
an integration of research results 
with practice and theory and a cognitive 
review of ones own knowledges and 
experiences. The best syntheses 
are topic driven, that is, focused 
around one or two significant issues. 
Quite ofter, this task is viewed as 
ideal for the "graduate student;" 
a method useful in helping them learn 
about the discipline. If our objective 
is to build a formal base of knowledge 
in the di sci pi i ne , though , effective 
synthesis requires practical and 
research experience to judge and 
rel ate the f i ndi ngs to the mul ti pi e 
aspects of an issue and discern the 
validity of methods, analyses and 
conclusions derived under a study. 
Some examples of useful research 
synthesi s are those reviews presented 
in the Review of Education (sponsored 
by the American Educational Research 
Journal ) , the Journal of Rehabil i tation 
October- December 1 981 special issue 
on rehabilitation of older persons, 
the Brown, Gordon and Diller (1982) 
revi ew of approaches to functional 
assessment and the Herbert and Menz 
(1 982) review of attitudinal effects 
of evaluation. Syntheses which could 
be useful for practice might separately 
focus on topics such as the following: 
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Synthesis of methods and models 
used to validate and norm 
devices and technology (tests , 
observational systems, performance 
systems, computerized assessment 
and ex pi oration systems) used 
in vocational assessment. 
What are the primary methods , 
which methods are most appropriate 
to which techno! ogy , to what 
broader psychometric or assessment 
models do they relate, how 
can they be used in field 
and commerci al settings , and 
what standards are currently 
applied in validation and 
norming? 

Synthesis of education and 
rehabil itation research literature 
on the effects of administrative 
conditions and learning on 
evaluative performance on 
aptitude and achievement tests, 
i nterest i nventories and work 
samples . 

Synthesis of research literature 
on cultural, language and 
functional bias in instructions , 
format and contents of primary 
psychometrics and work samples 
used in eval uation in both 
educational and rehabilitation 
settings. 

Synthesis of the til i ty of 
primary psychometric, work 
sample and situational observation 
systems with specified disability 
and ethnic groups. What evidence 
supports their use in vocational 
exploration, planning and 
deci sion-making and how val id 
is it to apply these devices 
with culturally distinct groups? 
Synthesis of the types and 
val idi ty of outcome i ndices 
and measures used to estimate 
the effects and efficiency 
of vocational assessment. 
What are they, what evidence 
supports their use and how 
can they be obtained and used 
i n eval uation of assessments 
provi ded with different popu- 
lations ,n different settings? 



Operations Research 

Operations research is a must 
for the individual assessment program 
and for the devel opers of eval uation 
technology. For the discipline, 
operations research is perhaps the 
form of research practice most likely 
to insure the kind of feedback which 
Welker (1973) believed a dynamic 
di :;ci pi ine must have to keep itsel f 
relevant. In deference to descriptive 
research , wi th i ts particul ar rol e 
of documentati on , under operations 
research ongoing data are collected 
and maintained in order to determine 
when and to what degree the program 
or devices on the market begin to 
yield differential effects. Analyses 
of these research data are conducted 
on a regular, cyclic basis (by program 
personnel or by commercial personnel) 
for monitoring and evaluation of 
impact, for monitoring changes taking 
place in a process or system, and 
to maintain control and planfulness 
in keeping with dynamics of a program 
or need for a product. For a program, 
data are regularly queried to determine 
change in immediate and long-term 
effects, in efficiency, resource 
utilization, equi ty , consi stency , 
repl icabil ity , and in populations, 
needs and priorities. For the commercial 
developer, operations research focuses 
on changes in validity, appropriateness 
with new populations, currency and 
norms of for devices and changes 
in product marketability and consumer 
needs. Many of the publications 
on program evaluation for defined 
systems provide guidance on how this 
ki nd of research mi ght be conducted 
in a vocational assessment program. 
Changes in the following are typical 
issues V:Mch should be regularly 
determined through ongoing operations 
research: 

1. Resource needs, availability, 
utilization and costs. 

2. Stability of outcomes, utility 
of evaluation results, and 
predictive val idity of training 
and employment recommendations . 
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3. Currency and validity of norms 
and normi ng popul ations for 
principal evaluation devices 
in use or being distributed. 

4. Reliability (stability) and 
val idity (accuracy) of eval uation 
and assessment data achieved 
under or observation and testing 
devices . 

5. Impact, needs and involvement 
of consumers in evaluation 
processes . 

6. Goals, technology and role 
of staff, evaluee and significant 
others in planning and delivery 
of assessment. 

7. Community, referral, funding 
and political support for 
program. 

Foundations Research 

Foundations research focuses 
most peculiarly on the validity of 
our endeavors, going into greater 
depth and general izabil ity of the 
specific applied contexts of issues 
under operations research. Again, 
the issues related to are those of 
normi ng, of validity and consistency 
of the technology we use (tests, work 
samples, observation systems, batteries, 
commercial eval uation devices we buy, 
adapt and use) and of the composite 
effectiveness of the processes, practices 
and technologies we bring together 
in evaluation. These are planfully 
devised research, research upon which 
generalization can be accomplished 
and research which challenges and 
raises issue with the precepts, theories 
and fundamental assumptions upon which 
the discipline is currently based. 
The null hypothesis that "the Emperor 
is naked 11 is repeatedly tested. The 
results of these many- folded research 
efforts, for instance, are intended 
to dispel false assumptions about 
what it is that eval uation can do , 
el iminate fal se expectations for evaluation 
technology and discourage use of invalid 
devices and observational techniques. 

There are of course many issues 
surrounding how one goes about doing 



this kind of research, but there 
is also a substantial body of 1 i terature 
to provi de gui dance for devel opi ng 
evaluation programs' and evaluation 
devices (whether practitioner, research 
or system/test developer). McCray 
(1982) describes what is needed and 
how one goes about setting up a vocational 
assessment program that can help 
to identify both toe vocational and 
educational needs of students. Esser 
(1980) provides suggestions on how 
to construct uceful , non-standard 
instruments that can be used to gather 
eval uation data . Dunn (1 973) and 
Dunn, Korn and Andrew (1976) explore 
in detail many of the issues and 
orovide direct suggestions about 
how to get on with this kind of task. 
Botterbusch (1981, 1982, 1984) provides 
not only guidance on what constitutes 
a good work sample, but ready reference 
to how many have currently failed 
to demonstrate their worth and provides 
some very fundamental methods for 
es tima ti ng validity, rel iabil ity 
and norms. Berven and Maki (1982) 
offers a contrasti ng method for establ ish- 
ing norms among em pi oyed cl ients . 
Fiske (1960) provides convincing 
discussion of the basic pro bl ems 
in measuring capacity and performance 
and Finch and Impel 1 itteri (1 971 ) 
provide a valuable discussion paper 
on how valid work performance measures 
are developed,, Guion (1979) provides 
a series of discussions and method 
papers on alternative methods for 
validation of performance and work 
sample assessment devices. 

Perhaps, more so than any other 
aspect of research on assessment, 
the issues of concern here are perennial 
ones; ones which our research must 
address over and over again. Some 
of the more representative of these 
research issues are the following: 

1. Effectiveness assessment 
agai nst multiple outcomes , 
including utility of recommen- 
dations, predictability of 
traini ng achievements , impact 
on rehabil itation/habil itation 
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and vocational and economic 
success. 

2c Differential effectiveness 
with specific disability, 
ethnic and cultural populations, 

3. Utility and val idity of evaluation 
i n educational and vocational 
planning. 

4. Therapeutic or incremental 
contributions of evaluation 
and assessment to educational 
and vocati onal rehabil i tat ion 
and habil i tation. 

5. Reliability ( i nter- rater ) 
and validity of behavior obser- 
vations in situational assessment, 
simul a ted work and competitive 
work settings. 

6. Direct effects of evaluation 
and assessment on evaluee 
self knowledge, ability to 
plan and achievement of vocational 
or educational goals. 

7 . Impact of standard and non-standard 
administration to special 
populations. 

8. Reliability, validity and 
utility of commercial work 
samples, psychometric instruments, 
computerized evaluation and 
exploration systems, and obser- 
vation systems wi th discrete 
populations. 

9. Job analysis, norming and 
assessment of performance 
skill s and aptitudes for emerging 
occupations and industries. 

10. Validity of follow-up methodo- 
logies in obtai ni ng qual i ty 
data. 

11. Cost-effectiveness and social- 
effectiveness of vocational 
asses sment. Including such 
concepts as return on investments 
of publ ic and private funds , 
wage earnings, quality of 
life. 



Inferential Research 

Inferential research differs 
from foundations research in one signifi- 
cant way: It is not necessarily geared 
to resolving a problem related to 



validity. Here, we are concerned 
with hypothesis testing research 
as most of us trained researchers 
were led to believe in. This research 
deals with questions like "what if 
..." Issues like, "If we identify 
assessment combi nations congruent 
with the cognitive, information processing 
characteristics of clients, do such 
combinations yield a greater range 
of vocational objectives for clients? 11 
or "Are there learning curves for 
work samples and to what extent do 
differing numbers of trials produce 
better or poorer prediction of capacity 
to do the task?" (Coker and Blakemore, 
1 984) or "Are there differential 
deci sion-maki ng patterns for di sabl ed 
high school students and disabled 
adults?" (Czerlinsky, 1984). The 
objective of this research is to 
discover new relationships and extend 
knowl edge about the meaning of prior 
theory and research. Typical research 
quest i ons that need to be answered 
under carefully designed research 
are among the following: 

1. To what extent are the utility 
and impact of evaluation 
controlled by evaluator varia- 
bles? In particular, evaluator 
theoretical orientation, 
com pete nee , trai ni ng , rol e 
expectations and expectations 
of the evaluee and evaluation. 

2. How are results on measures 
of aptitude, skil 1 , achievement 
and interests affected by 
evaluee responses to evaluation 
conditions? Specifically, 
how do evaluee sex, age, 
d i sa b i 1 i ty , t e s t- ta k i ng anxi ety , 
learning s tyl e (co gni ti ve 
responses to instructional 
format) , changes i n learni ng 
under repeated trial, and 
vocational maturity differentially 
affect level and quality 
of scores on performance 
based (e.g., gross motor* 
f i ne dexterity, production 
rates) and psychometric instru- 
ments? 

3. What decision-making approaches 
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are used by eval uees and eval uators 
in planning and synthesis 
of evaluation? How do such 
approaches interact and are 
there optimal comb inat ions 
of eval uator-eval uee decision- 
making? 

4. To what extent do evaluees 
assimilate and synthesize 
evaluation i nformation and 
how sight these capacities 
infl uence the degree to which 
eval uees participate in or 
direct their own evaluation 
and planning? 

5. To what degree' are the utility 
and impact of evaluation diffe- 
rentially affected by length 
of eval uat ions , specificity 
of presenting questions , emphasis 
given to various types of 
evaluation devices (e.g., 
psychometrics, work samples, 
situational assessment , computer 
syntheses) and such other 
manipulate evaluation situation 
variables (e.g. , setting in 
school, consistency in funding, 
staffing, fee level ). 

6. Through what developmental 
stages (e.g., phases, steps) 
do evaluees proceed, during 
and following evaluation, 
which provide the greatest 
assurance that their capacity 
to independently utilize infor- 
mation about their skills, 
aptitudes, interest and needs 
will achieve a usable "level? 

7. What incremental values are 
there for psychometrics, work 
sampl es , situational assessments, 
counseling, eval uee participation 
and involvement of significant 
others on selection of a satis- 
factory vocational goal. 

Research on Professional Issues 

Research on professional issues 
spans a wide range of potential problems 
which may need to be solved and issues 
which need to be periodically reexamined 
by a discipline. In a most general 



fashion, these issues relate to assuring 
continuing relevance and quality 
among personnel and systems (organization 
and political) under which vocational 
assessments are provided. Studies 
conducted by Coffey (1978), Coffey, 
Hansen, Menz and Coker (1977), Ellien, 
Menz and Coffey (1979), Sink and 
McCrosky (1979), and Menz (1983b) 
provide examples of how surveys can 
be used to address issues of professional 
competence and manpower needs. These 
researches shoul d be regul arly conducted 
to establish both baseline levels 
and changes that are or need to occur 
in definite areas: 

1. Determine characteristics 
of and changes in need for 
assessment personnel. In 
particular, numbers of personnel 
in various settings and roles, 
salaries and fringe benefits, 
stability and attrition, 
rates of career advancement, 
professional' affiliations, 
qual i f i cations and training, 
perceived skill deficits 
and expectations for changes 
in numbers and roles demands. 

2. Identi fy competencies needed 
by professional s to conduct 
evaluations in representative 
settings (e.g., facilities, 
hospitals, schools, commercial 
settings), under different 
evaluation models (e.g., 
adjudication of disability 
claims , vocational explorations, 
planning for training) and 
with di f ferent popul at ions 
(e.g., cognitively limited, 
cul tural di f ferent groups , 
non-English speaking persons). 
For instance, increased immi- 
gration of Spanish speaking 
clientele in urban areas 
could lead to needs for students 
in vocational evaluation 
programs to become flj-int 
in a second language (Spanish) 
and develop a wording knowledge 
of certain distinct culture , 
in order to do meaningful 
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vocational planni ng with this 
population. 

3. Validate and norm certification 
and licensure instruments. 
As populations, technology 
and uti 1 ization of vocational 
assessment changes are reflected 
in needed competencies, devices 
used to assess such competence 
need to be adapted and renormed 
to effectively exclude unaccept- 
ably skilled personnel from 
the discipline. 

4. Evaluate how current public 
pol icy impacts upon and restricts 
access to vocational assessment. 

5. Identify changes in needs 
and priorities for eval uation 
cl ientel e. 

6. Identify and prioritize needs 
and issues for the profession. 

7. Establish standards for ethical 
practice, minimum standards 
for evaluation programs and 
standards for validation and 
utilization of evaluation 
devices. 

8. Identify alternative research 
methodologies for judging 
the utility and impact of 
assessment and for validation 
of emergent vocational evaluation 
technology. 

Topical Research 

The last classification of needed 
research is topical research. Topical 
research is research driven more by 
curiosity about unknown relationships 
of events to causes, events to events 
and causes to causes than by formally 
stated theory. I like the idea that 

" seeking main effects in social 

research is a 'fool's errand' ... in 
that laws governing the behavior of 
peopl e are much too com pi ex to be 
delved into with simplistic (single) 

cause and (single) effect models n 

(Cook et al . in Brown et al., 1982, 
p. 6) This kind of research is needed 
to help us sort out some of the complex 
interrelationships that not only exist 
between the assessment and utility 



in education and rehabi 1 i tati on , 
but also to sort out some of the 
complex interrelationships that exist 
within the processes and devices 
themselves. 

Rather than asking the questions 

"What is the validity " or "What 

if which characterizes inferential 

research and ope rat ions research, 
this research is as much a search 
for the research question as it is 
some test of a hypothesis. It is 
the kind of research which has its 
or i gins in ideas other than those 
which may appear in the title of 
a proposal or report on a piece of 
research. Quite often, this type 
of research be gins when one seeks 
greater meaning from a given piece 
of research; perhaps as one conducts 
a secondary analysis of the research 
data under a different analytic model 
or from a different philosophical 
perspective (e.g. , a sociological 
perspective instead of a psychometric 
perspective). The issues concentrated 
upon may be narrowl y conceived or 
complexly interrelated, may be derived 
from careful anal ysi s of exi sti ng 
research or the 1 iterature and may 
be approached under as caref ul ly 
controlled designs as with a more 
cogently useful bit of inferential 
research. Some exam pi es of ones 
whi ch mi ght have exci ti ng resul ts 
are the following: 

1. With what reliability can 
data from one assessment 
device (e.g. , an aptitude 
test) be used to estimate 
performance on a construct 
similar i nst rumen t (e.g. , 
another aptitude test) among 
specific groups and for indi- 
viduals? 

2. If one were to consider the 
"eval uation process" as analogous 
to a test and that reliability 
of the process is of paramount 
first importance , can a methodo- 
logy be devised and tested 
which woul d provide a meaningful 
estimate of the internal 
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consistency of the evaluation 
process? 

3. If systematic bias (discrimination 
on the basis of non-construct 
related variables) is found 
with a particular evaluation 
device, among a particular 
population (i .e. , inval idity) , 
under what conditions can 
the effects of such bias be 
sufficiently estimated to 
allow adjustment in scores 
and warrant its use with those 
discriminated groups or indivi- 
duals? 

4. Is disabil ity (or need) distributed 
in a geographically equitable 
fashion? If "disabil ity" 
is found to be cl ustered in 
certai n popul ati on setti ngs , 
how might such densities affect 
publ ic pol icy on Drovision 
of assessment and other habili- 
tation services? 

Conclusions 

At this point in the development 
of the discipline, is it time to consider 
vocational assessment as a science? 
As Neff put it "... the essence of 
the technique of science ... boils 
down to ... controlled observation 
.... The fundamental issues ... which 
faces us in this field is: Can we 
control our observations of behavior 
... so that the statements we will 
make have a determinant degree of 
dependability and reliability? 11 (Neff, 
1969, p. 29-30) 

Are observations and syntheses 
of assessment data dependable and 
reliable? What is the degree of error 
we make in our predictions for training 
and employment? Have the devices 
we use been cal i bra ted to the groups , 
tasks and conditions under which we 
employ them? Are the assumptions, 
operational definitions and basic 
theorem of our practice documented 
and periodically subjected Id empirical 
evaluation? Do we have tradition 
and a body of research which empirically 
bears out our practices, processes 



and technologies of assessment? 
Have our fundamental hypotheses been 
subjected to the scrutiny of repl i cation 
and time? 

These quest ions are some to 
which "yes" answers would be expected 
for a discipline wishing to acquire 
the dubious distinction of being 
a sci ence . And dubi ous it is. Fron; 
where I sit as a researcher, this 
discipline is an applied one, working 
with, assessing ^nd aiding people 
with varying degrees of disability 
(or vocational confusion) to choose 
goals, training and employment which 
will best meet their economic and 
social needs. Whether or not vocational 
assessment is a science is a non-issue. 
Whether those of us in or around 
vocational assessment are willing 
to make the personal and professional 
i nvestments to make sure that there 
remains validity and relevance in 
what we are doing is the real issue. 
Conducting meaningful research and 
building a body of knowledge which 
i s subject to a mi nimum amount of 
bias and error is what we shoul d 
be pursuing. When that has been 
done, move on to coming up with answers 
to the questions asked in the paragraph 
above. Not until our responses to 
those are "yes" is it the time to 
begin a dialogue on whether vocational 
assessment is a science. 

"In this period ... tremendous 
strides have been made in the 
devel opment of knowl edge and technol ogy 
in vocational assessment. However, 
there is much work yet to be done 
in developing a sound empirical 
base for vocational assessment 
procedures and programs. Vocational 
assessment has a great impact 
on the lives of individuals with 
handicapping conditions, as it 
pi ays a major rol e in determi ni ng 
whether parti cular em pi oyment 
and training opportunities will 
be provided or denied. Consequently, 
research in this area would seem 
deserving of a high priority." (Berven, 
1983, p. 7-8) 
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Should we look at the >esults 
of our research and development efforts 
over the past two decades with dismay? 
Should we feel inadequate because 
we have not established principles? 
Should we view this discipline in 
a cynical light and conduct that 
its basis is msound? I think not. 
Two fundamental lessens can be derived 
from the above rev' : :w of our progress 
in research. First, it should ranind 
us that if research is co play a part 
in establishing the validity of a 
di set pi ine , it is not a one- shot activity. 
Rather, it builds by reducing and 
isolating basic relationships. One 
study builds upon anoLher, replications 
eliminate chance, complex designs 
elicit the tangled interrelationships 
between practi ces , technol ogies , cl ientel e 
and multiple criteria and practiced 
syntheses provide critique of our 
assumptions and tentative conclusions 
leads to fact. Second, knowledge 
is not a constant, once obtained, 
tested and replicated, always to remain 
the same. A discipline evolves. 
Events surrounding our practices forge 
new directions and shape our thinking 
and techno^gy. The intelligence 
of practitioners, clients and advocates 
will always allow them to reconstrue 
what they do as they become involved 
in different settings with different 
problems and different people. The 
validity of our "knowledge," "processes" 
and "technologies" will have to be 
reestatl ished. 

Many of the issues which were 
raised in the 1 960s and 1 970s will 
continue to be ones we must face in 
research, not oecause of * failure 
of the discipline, but because they 
are , quite simpl y , the questions we 
must repeatedly ask if vocations! 
assessment is to remain real : Is 
what we are doing consistent in terrrs 
of tiie people we serve? Is it valid 
for the purposes and persons we use 
it with? Does it produce the desired 
effects efficiently? Does it do so 
without prejudice? Is it needed? 
What is wrong with it and how can 
we improve it? Are we competent to 



do it? Is it meeting the needs of 
our target popul at ion? This paper 
has attempted to remind the discipline 
of the role which research does play, 
to restate the perennial issues and 
needs for research in contextual ly 
meaningful terms and to provide a 
classification of research that will 
help us to continue with the most 
important task of providing valid, 
impactful and relevant vocational 
assessment. 
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THE VOCATIONAL EVALUATOR AS EXPERT 
WITNESS 



CINDY ELLIS 



ABSTRACT: Much attention has been 
focused on the emergence of the private 
practice of rehabilitation. "Private 
rehabilitation" as it is commonly 
called is considered by some to be 
an impressive growth industry (Lauterbach, 
1982). Recent rehabilitation graduates 
are flocking to private rehabilitation 
companies for employment in record 
numbers. Third party payers such 
as insurance companies, employers 
and attorneys have recognized the 
value of rehabilitation and are hiring 
their own in-house rehauil itation 
staff. The courts, at long last, 
seem to be recognizing the value of 
rehabilitation information in determining 
employabil ity issues. 

Finally, the Bureau of Counselor 
Certification (previously CRCC) has 
developed a special certification 
(CIRS) essentially targeted for private 
practitioners . 

At face value, it would seem 
that private rehabilitation is well 
on its way from 10 years of relative 
obscurity to recognition and acceptance 
today. Inherent in the above scenario 
is the fact that a variety of rehabili- 
tation professionals (counselors, 
job developers, nurses, vocational 
evaluators, psychologists, etc.) are 
provi di ng a vari ety of servi ces in 
rel ati vel y new and diverse settings. 
Where, in the scheme of private rehabil- 
itation does the vocational evaluator 
fit? Are the evaluator's distinct 
skills recognized in the rehabilitation 
process or 1 i ti gat ion? And 1 ast , 
how is the vocational evaluator used 
as an expert witness? This paper 



addresses the major issues of the 
vocational evaluator in r^ivate practice 
and as an expert witruv;s. 

The Evaluator 5 s Role 

The vocaMo»,al evaluator has 
pi ayed a rel at' /ely mi nor rol e in 
private rehabilitation, unfortunately, 
at least as compared to his/her potential 
contribution. T ; >(= majority of employees 
in private rehabilitation are rehabil- 
itation counselors and rehabilitation 
nurses. The r.^t frequently offered 
services in pn'v&te vocational rehabil- 
itation are rehabil itation counsel ing 
and job devel opment (Matkin, 1982, 
p. 32). There teems to be confusion 
in the 1 ega"! communi ty about the 
distinction between vocation ! evaluation, 
re ha bi 1 i ta ti on counse l or s and job 
developers, as suggests in a recent 
survey of ai^orrujvk (Brandon, 1983) . 
In private prsc^-o^, the issues of 
e m p 1 o y a b i 1 i ty , j • ■ h com pa ti bi 1 i ty , 
and labor market are often times 
the keys issues. Considering that 
many pri vate rehabil itation cl ients 
have experienced a handicapping condition 
which impacts on thei r vocational 
f unctioimit! in some way, vocational 
evalua'crs , with their special areas 
of expertise in testi ng , counsel i ng 
and job matching, would seem to be 
an important if not i ntegral part 
of the process. 

Consider the definition of vocational 
evaluation given the 10th Institute 
on Rehabil itation Services (1972) : 
"Vocational (work) evaluation is 
a comprehensi ve process that system- 
atical ly tstll izes work, real or simulated, 
as the focal point for assessment 
and vocational exploration, the purpose 
of which is to assist individuals 
in vocational devel opment. Vocational 
(wor k) evaluation incorporates medical , 
psychological , social , vocational , 
educational , cultural and economic 
data in the attainment of the goals 
of the evaluation process." We can 
only speculate why vocational evaluations 
as def i ned above and the vocational 
evaluators who provide these services 
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are not more ''cri ti cally involved in 
private rehabilitation as expert wit- 
nesses. Whether it is the evaluator's 
historical subordination to the rehabil i- 
tation counselor as suggested by Mason 
( 1983) or the evaluator's lack of 
aggressiveness in maintaining their 
domain in vocational evaluation (Ellis 
1983), it is clear that the vocational 
evaluator has much more to contribute 
to the private practice of rehabil itation. 

Eval uators are i nterfacing vr th 
proprietary rehabilitation in increasing 
numbers. Some wear two hats, both 
as evaluators and counselors in private 
firms. Others work in sheltered workshops, 
hospitals or proprietary assessment 
centers where litigated cases are 
seen for vocational evaluations. 
Thus the evaluator may be called as 
an expert witness. Lynch (1983) offers 
the following definition of the vocational 
expert: "Vocational experts are respons- 
ible for critically reviewing supporting 
documentation (e.g. medical or psychi- 
atric); performing a vocational diagnostic 
interview; noting critical work behaviors; 
translating residual functional capacity 
into vocationally relevant terminology; 
selecting, administering, scoring 
and interpreting the appropriate assessment 
tools, (e.g. tests of intelligence, 
achievement, a pti tude , vocational 
i nterest, dexterity); locating, assessing, 
and integrating rehabilitation research 
re-.vant to the type of disability 
involved; understanding vocational 
development theory; job requirements, 
and the world of work; securing labor 
market and wage information; and presenting 
logical and substantial conclusions 
based on objective findings." It is 
in and around these issues that vocational 
evaluators can make significant contri- 
butions as expert witnesses. 

The Nature of Cases 

The role of the vocational expert 
poses a unique set of considerations 
and challenges in both conducting 
the vocational evaluation and testifying 
in a court of law. One of the first 
considerations is the nature of the 



case. The majority of cases are 
worker compensation, ,in which a worker 
has been injured on the job and the 
injury impacts on the worker's vocational 
functioning. In these cases, the 
rehabilitation involvement is directly 
related to the return to work hierarchy 
as summarized by Sink (1933). 

1. The worker recovers from the injury 
and returns to work in the same 
job with the same employer without 
modifications. 

2. The worker can return to work 
i n the same job with the same 
employer with modifications. 

3. The worker can return to work 
with the same employer on a different 
job without modifications at equal 
or better pay. 

4. The worker can return to work 
with the same employer on a different 
job with modifications at equal 
or better pay. 

5. The worker can return to work 
with a different employer at the 
same job without modification 
at equal or better pay. 

6. The worker can return to work 
wi th a di f ferent empl oyer at the 
same job with modifications at 
equal or better pay. 

7. The worker can return to work 
for a different employer on a 
job in which he or she has never 
been employed, but for which he 
or she has transferable skills 
and formal retraining is not required. 

8. The worker can return to work 
only if formal training is the 
only feasible alternative available 
and the worker has. the ability 
to successfully complete the training. 

9. The worker does not have potential 
for competitive employment. 

Vocati onal eval uati ons may be 
indicated in level four (4) and levels 
seven through nine (7 - 9). In such 
instances the evaluator may be asked 
to determine the worker's ability 
to perform a new job with the employer, 
in which case a tai 1 ored eval uati on 
specific to measuring the job requirements 
for a parti cul ar job is in order. 

76 



ERIC, 



Often evaluators can play a critical 
role in the return to work with the 
employer by conducting an on-site 
visit to the employer, determining 
the hypothetical jobs the worker could 
perform, and evaluating the employee 
agair;st these criteria. It is not 
uncommon for an employer to stereotype 
an employee as skilled only in the 
job he/she performed at time of injury. 
A good eval uator can point out al ternati ve 
job slots the employer may not have 
considered. It is unl i kely such a 
case would reach the courts on the 
issue of empl oyabil i ty . 

Most often, however, the eval uator 
will be asked to determine employment 
potential for new job or training 
areas. In these cases, consideration 
must be given to not only prior work 
history/skills but aptitudes, interests, 
temperaments, general educational 
development and physical capacities 
as they relate to generic job competencies 
and labor market opportunities. Since 
the evaluation offers an opportunity 
for extensive behavioral observations, 
information about the worker' s functional 
work tolerances, return to work attitude 
and general work habits are important. 
Finally, for what jobs does the worker 
seem to be employable? Is the pay 
rate comparable to that at time of 
injury? If not, is the worker a candidate 
for training and what is the expected 
pay rate upon completion of training? 
Since each state has its own worker 
compensation laws, these issues may 
vary. Depending upon the law, evaluators 
may also be asked to calculate a vocational 
disabil ity rating, determining advancement 
potential in an occupation or consider 
roll back wages. 

Although worker compensation 
is the primary area for vocational 
evaluators as expert witnesses, there 
is a growing demand in the areas of 
personal injury , divorce , social security 
and long-term disability. Social 
security cases are distinctive in 
that empl oyabil ity opinions are based 
upon the availability of jobs in the 
national, not local, economy. Personal 
injury cases, although varied in referral 



purpose, generally focus on what 
the client's empl oyabil ity was before 
the injury, current employment options, 
and the impact of this over the life 
expectancy. These cases, by nature, 
tend to be more hypothetical and 
frequently are done in conjunction 
with an economist. 

An emerging area of practice 
for the vocational eval uator is divorce. 
Since al imony is somewhat dependent 
on the spouse's present and future 
earning capacity, vocational eval uations 
are extremel y hel pful in determining 
vocational potentials for spouses 
who have never worked or who cl aims 
he/she cannot work. Often times 
the results of the vocational evaluation 
serve as the rehabilitation plan 
which is then awarded as part of 
the divorce settlement wi th antici pated 
earnings offset against alimony. 

With an increase in litigation 
and use of vocational experts in 
general , there is a trend to use 
vocational experts for independent 
evaluations, trial consultation or 
rebuttal witnesses. Since the legal 
system is by nature an adversary 
one , opposing attorneys may find 
need to obtain an opinion about the 
rationale for a particular vocational 
eval uation , interpretation of test 
results, or con cl us ions and recom- 
mendations. This may range from 
simple review of records to conducting 
an i nde pendent eval uation fol lowed 
by formal testimony. Although this 
conce pt i s somewhat forei gn in the 
vocational re ha bi 1 i tat ion system , 
this is frequently seen, for example, 
in presenting medical evidence, where 
doctors called by each side present 
their opinions as to the reason for 
the onset of disability, differing 
recommendati ons for treatment , degree 
of di sabil ity, etc. 

Conducting the Vocational Evaluation 

In conducting vocational evaluation, 
the following guidelines will be 
helpful if a court appearance is 
anticipated or required: 
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Develop a sound evaluation plan 
an d rationale . As simple as this 
sounds , it is the single most overlooked 
aspect in a vocational evaluation. 
The purpose of the vocational evaluation 
shoul d be to answer the referral 
questi ons whi ch have been posed 
by the referral source. If no 
referral questi ons accompany the 
case, the evaluator should contact 
the referring party and determine 
the referral issues. The evaluation 
plan should reflect the most effective 
strategy for answering referral 
questions by col 1 aborating existing 
information or discovering unknown 
information about the client. 
Avoid redundant testing or over 
testing as it gives the appearance 
of being undirected. 
Thoroughly review referral material . 
Usual ly medical reports constitute 
the bulk of referral data. Since 
the vocational evaluator must consider 
the cl iant 1 s current and/or anticipated 
restrictions, request that some 
type of physical functioning form 
be filled out by the physician. 
Check that the medical information 
is current and ask the referral 
source to provide the date of the 
last examination. Nothing is more 
frustrating than to complete the 
evaluation report only to fina 
out that a more recent medical 
examination defines different re- 
strictions than those used in your 
eval uation. 

Be thoroughly famil iar with evaluation 
i ns truments . If norm reference 
tests are used, be certain the 
norms are appropriate. Know when 
to use performance based instruments 
such as work samples as opposed 
to paper-pencil instruments. Carefully 
screen your assessment instruments 
to assure that test content correlates 
with evaluation objectives and 
accepted psychometric standards 
for validity and reliability. 
It is not uncommon to be asked 
questions about validity and reli- 
ability coefficients of testing 
instruments. 



4. Become familiar with the lab " 
market . Vocational eval uati o i 
resul ts are virtually useless 
if testing data is not linked 
real i sti cal ly with vocational 
objectives . The Dictionary of 
Occupational Titles , the Occupational 
Outlook Handbook and state and 
1 ocal 1 abor market publ i cations 
provide a starting point for linking 
evaluation data to vocational 
objectives. The evaluator can 
be certain he/she wi 1 1 as ke d 
how recommendations for jobs were 
made. These publ icat ions are 
the most widely accepted. Most 
ef fecti ve , however , i s f i rst hand 
knowledge of the local labor market 
which can be obtained from job 
pi a cement experience , visiting 
local empl oyers or school s , reviewing 
the want ads and/or visi ti ng the 
empl oyment office . This area 
is one of the weakest skill areas 
in most evaluation programs (Ellis, 
1983). Computeri zed job bank 
and job match programs make the 
job immeasurably easier. 

5. Write every report as if it were 
goi ng to court" ] Tn 1 i ti gated 
cases one can be sure that reports 
will be scrutinized by one or 
more attorneys if not a judge, 
jury and/or arbi trator . Records 
can al so be and often times are 
subpoenaed, incl uding case notes 
and raw data . Take care not to 
write subjective comments, non-case 
relevant notes or "doodles" on 
any case records. It can be embar- 
rassing to have one's artwork 
di spl ayed before judge and jury. 
Reports themselves should be as 
objective, accurate and clear 
as possible. Remember that the 
reader will probably have the 
greatest opportunity to cl i ni cal ly 
observe the cl ient during the 
eval uation process than other 
professional s . Therefore , objecti ve 
and carefully recorded observations 
about motivation, functional vocational 
tol erances , 1 earning abil i ty and 
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work style are unique contributions 
from the evaluator. 

Courtroom Survival Techniques 

Very few individuals relish the 
prospect of taking the witness stand, 
situated as it is between two opponents, 
an imposing looking judge and in some 
cases a jury of thirteen fellow citizens. 
However, in this increasingly litigious 
society, vocational eval uators can 
expect to find themselves in court 
either as a result of expanded areas 
of practice or subpoenaes. Since 
this is a relatively new terrain for 
rehabil itation providers, especially 
vocational evaluators, the following 
tips may help in surviving and even 
enjoying the experience. 

1. Never blame attorneys for being 
attorneys . One must recognize 
the legcl system for what it is—an 
adversarial one. When a case goes 
to court it is because there is 
a dispute. Attorneys are repre- 
senting each side of the dispute, 
advocating the greatest degree 
possible for their client. It 
is just as much the opposing attorney' s 
responsibility to point out the 
weakness of the expert's testimony 
as it is the expert's attorney 
to draw out the strong points. 
That is their job , just as it is 
the expert's job to impart his/her 
expertise. It is critical to understand 
this and to not take the courtroom 
experience personally. 

2. You are the expert . The Vocational 
Expert is being called because 
he/she possesses a special body 
of knowledge. It is important 
that the retaining attorney understand 

■ your area of expertise as well 
as your 1 imi tat ions , For this 
reason it is highly recommended 
to meet before the tr*ia: to explain 
the vocational evaluation, conclusions, 
recommendations, etc. It is also 
helpful to ask for an overview 
of the questions that will be asked 
on direct examination and ant;,ioated 
questions on cross examination. 
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When speaking to the judge and/or 
jury, remember they are probably 
not familiar with vocational evalua- 
tion . It i s your responsibil i ty 
to communi cate i n understandable 
terms your procedures and findings 
and, if necessary, to educate 
them about your profession. As 
one arbitrator once related, "You 
know, we didn't understand x-rays 
when they first came out either. 11 

3. Be prepared . Preparation begins 
with the day the case is received, 
starting with developing the evaluation 
plan, through testing, report 
wri ti ng and testimony. Although 
it is not necessary to memorize 
the report and all test manuals 
(it is usually permissible to 
refer to notdS ) there i s no substi tute 
for being thoroughly familiar 
with case data , general test con- 
tent/technical information, significant 
data, and most of all, rationale 
for findings. Equally important 
is to be aware of what areas are 
out of your expertise. It is 
not uncommon for the opposing 
attorney to ask 1 eading questions 
to entice the rehabilitation specialist 
to answer questions out of their 
area, mainly along medical lines. 
Expert wi tnesses who fal 1 prey 
to this technique appear less 
credible. It is preferable to 
respond that you don't know the 
answer to a question or that it 
is not in your areas of expertise. 

4, Qualifications are important . 
Prior to giving testimony the 
witness will be asked to give 
qualifications to demonstrate 
that he/she actually is a vocational 
expert. Questions about education, 
special training, relevant employment 
history, professional affiliations, 
presentations and publications 
will be asked. Since the vocational 
expert is a relatively new witness 
in the legal system, those vocational 
eval uators pi anning to enter this 
field should maintain certifications 
such as CVE, CRC, attend seminars 
and workshops, and maintain relevant 
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professional affiliations. A curriculum 
vitae is necessary and may be placed 
into evidence in view of verbal 
qualifications. However, it is 
often perferable, in jury trials 
especially, for the jury to hear 
qua! ificat ions verbally, as it 
creates a core credible atmosphere. 

5. Appearance makes a difference . 
As is true in most situations , 
first impressions are important 
in court proceedings. Almost without 
exception, witnesses should wear 
a business suit of a conservative 
nature. The same applies to make-up, 
hair style and accessories. An 
air of confidence and poise communi- 
cates competence. Pretrial jitters 
are normal and can be diminished 
by bei ng wel 1 prepared . Good eye 
contact with the judge, hearing 
officer or jury is important. 
Remember, they are the recipient 
of the evidence. It is the e valuator's 
responsibility to present the in- 
formation clearly, competently 
and sincerely. Following this, 
the judge or jury weighs the evidence 
in consideration of all other testimony 
and they make the decision. 

6. Take the time to learn about the 
legal system . As evaluators, we 
are rel ati vely isolated from the 
proceedings in a court of law, 
whether it be an arbitrator's room, 
a judge's chambers or a court room. 
If evaluators are to appear in 
these settings it is imperative 
to understand the b^^ic dynamics 
such as direct and cros: examination, 
re-d'irect and re-cross as well 
as the distinct roles of the witnesses , 
attorneys, and judge or hearing 
of f i cer . Al though space does not 
allow an elaboration of these points, 
a basic law book, or better yet, 
an inservice from a local trial 
attorney would be very beneficial 
in learning about the trial system. 

Summary 

It is t hi s writer ' s opi nion that 
the vocational evaluator has a great 



deal to contribute as an expert vocational 
witness. Our unique skills in behavioral 
observations , vocational diagnostics, 
and job matching meet th2 needs that 
are most f requentl y re qui red of a 
vocat n * oual wi tness--determi ni ng empl oy- 
abil ■;*>• issues . However, up until 
this point, evaluators have had their 
heads in the sand regarding the advocation 
and marketi ng of our profession to 
new referral sources , sources such 
as the insurance industry and those 
requiring expert vocational witnesses. 
Furthermore , vocational eval uators 
have shown deference at best, if 
not apathy, towards other professions 
which have adopted the term "vocational 
evaluation" to descri be services 
such as a transferability of skills 
analysis, a rehabil itation interview, 
or even a simple file review. There 
is also a trend for profess ionals 
such as occupational therapi sts and, 
to a more 1 i mi ted degree , rehabil itation 
counsel ors, to perform vocational 
evaluations. In this writer's opinion, 
such use of evaluation will serve 
only to dil ute the profession. Eval uators 
need to take a much more aggressive 
stand in educating , marketi ng and 
protecting the domain of our disci pi ine. 
Otherwise, we run the risk of becoming 
an endangered species. 
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SCHOOL-BASED VOCATIONAL ASSESSMENT: 
A COMPREHENSIVE, DEVELOPMENTAL APPROACH 



MICHAEL PETERSON 



ABSTRACT: In the 1 ast fifteen years , 
as speci al needs students have been 
increasingly invol ved in career education 
and vocational education programs , 
uti 1 i zati on of vocational assessment 
has increased. However, while models 
have been developed and solidified 
in rehabilitation (Nadolsky, 1972, 
1973; Baker & Mercer, 1974), models 
for vocational evaluation and assessment 
of special needs students in school 
settings are still in great flux. 
There are significant questions and 
disagreements concerning; what is 
to be assessed, for what purpose, 
what recommendations and other outcomes 
should be available, who is assessed, 
by whom, when assessment is to be 
done, when it is implemented, and 
how often (Peterson, 1981, 1983). 

Two basic approaches are seen 
in the literature: (a) curriculum-based 
vocational assessment, (b) vocational 
evaluation centers. It is the purpose 
of this article to briefly describe 
each approach, consider the strengths 
and weaknesses of each, and to propose 
an eclectic model that provides a 
comprehensive , devel opmental approach 
to vocational assessment that combines 
the most useful aspects of each model . 



Curriculum-Based Vocational Assessment 

Curriculum-based vocational 
assessment refers to the use of existing 
school resources to obtain vocational 
assessment data about students. 
Such an approach has been advocated 
by an i ncreas i ng number of writers 
as^ being a cost-effective method 
for obtai ni ng vocationally relevant 
data from the regular school environment 
i n a way that maximizes its 1 ikely 
impact on instruction and curricul urn 
(Stodden, 1980; Clark, 1972; Patten, 
1981; Posey, 1982; Peterson, 1980; 
Si tl i ngton , 197 8; Phel ps , 1984) . 
Curricul um^based vocational assessment 
is usually considered to begin no 
later than late el erne n tar y school 
and to continue through the student's 
publ ic school career. Duri ng the 
vocational and career development 
of the student, information is gathered 
at the various stages of orientation, 
exploration, and prenaration (Phelps, 
1984) and used to develop IEP's that 
facil itate career education and vocational 
development. 

The methods used to gather infor- 
mation in curricul urn- based vocational 
assessment are mul tipl e and varied. 
The fact is that a rich source of 
assessment data is available in school 
setti ngs. However, such information 
is most often not i nterpreted in 
light of vocational devel opment . 
Methods may include those listed 
in Table 1. 

Curricul urn -based vocational 
assessment has both significant advantages 
and disadvantages. On one hand, 
gathering vocational assessment infor- 
mation from existing curriculum and 
special education testing procedures 
can be very cost effective. On the 
other hand , the danger exists that, 
depending upon the pre -vocational 
and exploration curricula of a particular 
school , a student may not have an 
opportunity to mani fest vocational ly 
relevant skills and interests. 

Implementing curricul urn- based 
voca ti onal assessment al so requires 
attention to personnel considerations. 
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Some individual --whether a full-timo 
vocational assessment special ist, 
vocational counselor, schoo 1 
psychologist— with both the time ana 
skills in vocational assessment must 
coordinate the process. This individual 
must be actively involved in setting 
up a process, training teachers- and 
counselors to use checklists and other 
instruments, and helping educators 
to use information to develop IEP's. 



Table 1 

Methods of Curriculum-based Vocational Assessment 



Special Education Classes 

Checklists of vocational and prevocational skills 

Mnterest assessment 

*Student and parent interviews 
Sc hool Records 

Special Education Testing and Assessment 

♦Psychological , educational, social 

*May include interest and aptitude assessment 
P revocational Classes 

Checklists of interest and vocational skills from: 

industrial arts 

*homemaking 

♦occupational orientation, etc. 
Physical Education Classes 

Checklists of physical skills 
Vocational Education Classes 

*Performance assessment 

Vocational classroom tryouts 



Vocational Evaluation Center Model 

Vocational Evaluation Centers 
invol ve a central ized location where 
in-depth vocational assessment and 
counseling occurs. Vocational Evaluation 
Centers may serve a regional area, 
be housed in mobile units, or be imple- 
mented in coordination with other 
agencies. Methods usually emphasize 
the utilization of i: work, real or 
simulated, as the focal point of assess- 



ment" (VEWAA, 1975) including: career 
exploration, vocational aptitude 
and interest testing, physical skills 
assessment, work samples , and situational 
assessment incl uding vocational classroom 
tryouts and job tryouts. 

The actdul process for centers 
located in schools is very similar 
to that described by Nadolsky (1972). 
However, some significant differences 
occur. Inese include a greater emphasis 
on vocational evaluation to recommend 
skills training (Pertri , 1980; Peterson, 
1981), utilization of vocational 
cl ass room tryouts and work samples 
based on vocational training programs 
(Wrobel, 1976; Lake, 1974), and utili- 
zation of vocational evaluation as 
part of a comprehensive support service 
approach for special needs students 
(Leconte & Roebuck, 1981). Specific 
examples include Project Serve (Wrobel, 
1976) and Vocational Support Service 
Teams utilized in Maryland (Marshall, 
Emerson, & Bailey, 1981). Laconte 
and Roebuck (1981) described vocational 
eval uation as impl emented in Maryl and 
schools as having an advocacy role 
in which the results of vocation J 
evaluation are actively communicated 
to parents and educators and follow-up 
concerning the impl erne ntat ion of 
recommendati ons from the vocational 
evaluation process is provided. 

Vocational eval uation centers 
also have s i gni f i cant advantages 
and di sadvantages. They potential ly 
provide an extremely val uable opportunity 
for students to experience a variety 
of occupations and be assessed relative 
to skills needed in those occupations. 
Such programs have been shown to 
have dramatic impact on student attitudes, 
moti vat ion , and sel f-concept (Menz , 
1978 ) . Additionally, vocational 
eval uation special ists act as highly 
competent support service personnel 
who can advocate for appropriate 
services for handicapped students 
(Leconte & Roebuck, 1981). On the 
other hand, Vocational Eval uation 
Centers are expensive and can be 
too far removed from actual instructional 
personnel . 
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Comprehensive, Developmental Approach to 
School -based Vocational Assessment 

1 hi s paper suggests using a combi- 
nation of the two approaches above 
to draw on the strength of each and 
provi de an on-goi ng , devel opmental 
assessment process. The approach 
is graphically illustrated in Figure 
1 and can be summarized as follows: 

figure 1 

Comprehensl ve» Developmental Approach to School-Based 
Vocational Assessment 

VOCATIONAL 
DECISION 
POINT 
Host often 10th 
grade and at 
at completion 
public school 
Begin by 6*h grade I 



(1) Curriculum 
Based Vocational 
Assessment 




(3) Curriculum-Based 
vocational assessment info 
referral info 



4. 



(4) Vocational 




{5) Coniflunicate 


Evaluation 


a. 


To school 


Center 




Personnel 



1 . Curri cul urn- based vocational 
assessment shoul d start in the sixth 
grade and be interactive with instruc- 
tion. Information gathered during 
these years should guide IEP development 
relative to career orientation and 
exploration, pre vocational skills, 
work behaviors, and functional living 
skill s. 

2. At major vocational decision 
poi nts , such as tfie year prior to 
potential entrance into vocational 
education, the interdisciplinary team 
decides if more information . is needed. 



If so, additional vocational assessment 
is scheduled which may include referral 
to a Vocational Evaluation Center. 
More information should be sought 
if information is not adequate to 
inform the vocational teacher on 
how to work with a student or if 
it is unclear or doubtful that a 
student has the abil ity to succeed 
in a vocational program. 

3. If a referral is made, the 
"Curricul urn- based Vocational Assessment 
Special i st" wi 1 1 compil e vocational 
assessment data gathered to date 
and provide specific assessment ques- 
tions . Thi s hel ps center personnel 
to not dupl icate information al ready 
gathered and to focus in on what 
yet needs to be done. 

4 . A vocational evaluation 
is implemented that is based on the 
needs of the student. Note that 
using a center does not at all prevent 
the use of vocational classroom tryouts, 
job tryouts, etc., as part of the 
evaluation process. Such methods 
have been used to especially good 
advantages in school situations (Wrobel , 
1978). 

5. Active methods are used 
to communicate vocational assessment 
information to instructional personnel 
so that IEP's and individual classroom 
plans may be based on this information. 
Various mechanisms have been used 
for this purpose. These include: 

(1) interdisciplinary team meetings 
following vocational evaluation, 

(2) development of summary reports 
sent to teachers and parents outlining 
results and implications (Patten, 
1981), (3) use of 1 iason vocational 
assessment counsel ors who hel p interpret 
vocational assessment resul ts in 
IEP meetings at a student's home 
school, and (4) follow-up on recommen- 
dations made in vocational eval uation 
reports (Leconte & Roebuck, 1981). 

Vocational assessment- -whet her 
curricul urn- based or in vocational 
Evaluation Centers— must pay attention 
to several key principals. These 
incl ude: 
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(1) Use of work, real or simulated. 
The more like real work, the more 
valid and useful are the results. 

(2) Assessment must be instru c- 
tional 1y rel evant. Student learning 
styles and abilities must be assessed 
and clear pictures of student strengths 
and needs must be developed using 
a program related assessed model. 
Thus vocational assessment shoul d 
result in recommendations that include 
program placement, data for specific 
objectives in a program.., and suggestions 
for useful instructional and behavior 
change techniques. More specifically, 
recommendations may include: vocational 
education programs, job placement, 
support services and community programs, 
teaching techniques and vocational 
curricul urn modifications, vocational 
information and exploration experiences, 
work adjustment training, academic 
course selection and functional living 
skills training (Peterson & Hill, 
1982). 

Several writers have attempted 
to blend a model of vocational assessment 
that utilizes the strengths of both 
curriculum-based vocational assessment 
and vocational evaluation centers. 
To this end, the Texas Education Agency 
(1979) developed guidelines concerning 
vocational assessment in which three 
levels of assessment were described: 
(a) Level 1 Vocational Assessment 
involved the use of existing student 
records and diagnostic data such as 
special education assessment, (b) 
Level 2 involved the use of basic 
vocational interest and vocational 
aptitude assessment, and (c) Level 
3 was entitled "Comprehensive Vocational 
Assessment, 0 or "Vocational Evaluation." 
Peterson and Hill (1982) in Project 
Voc-AIM developed a manual for the 
Texas Education Agency that described 
for p-blic schools the methods used 
to implement this process of vocational 
asser^ment. Peterson (1984) working 
with z national task force on vocational 
assessment of special needs students, 
developed a monograph which described 
a "basic vocational assessment" and 
"comprehensive vocational assessment." 



Pennsylvania (Department of Education, 
1983) developed a process of curricu- 
lum-based vocational assessment which 
also allowed the incorporation of 
vocational evaluation centers as 
needed. Posey (1982), and others, 
described a similar model for use 
in Arizona. 



Personnel in School-Based 
Vocational Assessment 



To implement the comprehensive 
model described above requires trained 
personnel. Vocational Eval uation 
Specialists -must be available to 
vocational eval uation centers and 
trained personnel must function as 
curriculum-based vocational assessment 
specialists. Depending upon specific 
school situations , these functions 
could be performed by the same person. 



Lible 2 N 

Personnel Roles in a Comprehensive. Developmental Approcch 

to School-Based Vocational Assessment 



Vocational Assessment 


Curriculum- Based 


Vocational Evaluation 


Special ist 




Center 




Analyze vocational 


Analyze requirements 


•Vocational Counselor 


ski 1 K in s'thool 


of jobs, voc ed 


•Vocational School 


curri culum 


classes, etc. 


Psychologist 


Develop and 


Assess students using 


*Work study 


coordinate input by 


tests, work samples 


coordinator 


teachers, parents, 




♦Rehabilitation 


etc. 




eva luator 


--Coordinate 


vocationa 1 -- 




class tryouts 




--Consult with teachers-- 




and parents concerning 




vocational !EPs, support 




services , 


curriculum 




modi f ications 




--Analyze and interpret-- 




vocationa 


assessment 




informatic 


n 



(table continues) 
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Table 2 (cont.) 



Schcol-Based Vocational 


Curriculum Based 


Vocational Evaluation 


Assessment Team 




Center 


Special Education 


Assess vocationally 




Teacher 


relevant skills 




Vocational Education 


Use resul ts to help 


Use results to 


Teacher, etc. 


develop career , 


. develop 




oriented IEP 


vocational IEP 



Additionally, vocational counselors , 
school psychologists , or other appropriate 
school personnel coul d imp! ement and 
coordinate curricul urn- based vocational 
assessment. Clearly, however, such 
individuals must have skill s in vocational 
assessment. The roles and functions 
of curriculum-based and vocational 
eval uation center-based assessment 
specialists are similar; but there 
are some di fferences . These are i ndicated 
in Table 2. Finally, assessment team 
members — teachers , counselors , school 
psychol ogi sts , etc. --must be trained 
both to participate in the vocational 
assessment process and to use 1- ts 
results in IEP development. 



Relation of Special Education Assessment 
and Vocational Assessment 

A final important note should 
be made that vocati onal assessment 
and existing special education assessment 
should be overlapping, coordinated 
processes. Too often these are developing 
as two, uncoordinated systems implemented 
by two sets of personnel who may or 
may not actively communicate. The 
vocational school psychologist movement 
(Hohenshil, Shepard, Capps> 1982) 
may assist in the development of a 
coord ina ted system. At least one 
vocational eval uation center (Patten , 
1981) has been staffed by school psycholo- 
gists who are also trained Vocational 



Eval uation Special ists. When vocational 
eval uati on is impl emented , assumi ng 
the schedule is appropriate, a student's 
re-eval uati on is implemented for 
special education. 

Conclusion 

This article has provided an 
overview of a coif.j'.; ehensive, developmental 
approach to school- based vocational 
assessment. The purpose of the model 
outlined in this paper is to actualize 
an assessment system to provide data 
upon which vocationally oriented 
IEP's may be developed in a cost-efficient 
manner and in a way that maximizes 
the opportunities available to handicapped 
students. The resul t will be better 
services and ul timate em pi oyment 
for handicapped students. 
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ASSESSMENT TECHNIQUES WITH THE LEARNING 
DISABLED STUDENT 



CATHY DIANE EMERY 



ABSTRACT: Providing reliable and valid 
assessment data for special populations 
requires a number of alternative approaches 
to assure that individual vocational 
needs are addressed appropriately; 
this is particul arly rel evant for 
learning disabled students. Techniques 
employed with other populations are 
ineffective or even detrimental with 
learning disabled students. This 
article presents pragmatic techniques 
to facilitate the total assessment 
process with this population. Questions 
concerning commercial assessment system 
design and established strategies 
are raised for consideration. 



The Education of All Handicapped 
Children Act (PL 94-142) in 1975, 
res ul ted i n vocati onal assessment 
services for the special needs popula- 
tion. Under this r gulation, the 
Federal government identified categories 
of handicapping conditions, including 
the learning disabled (LD) , and mandated 
the implementation of special education 
and rela ad services. 

Determi ni no ef f ecti ve assessment 
service delivery for LD students 
requires that the evaluation specialist 
carefully examine establ ished assessment 
model s . Tradi ti onal ly the ul timate 
goal of the rehabilitation model 
has been job placement. However, 
the emphasis fur providing assessment 
services in the school setting has 
been on career development and placement 
i n vocational programs. Furthermore , 
the relative importance of determining 
task- related abil Hies is diminished 
by the need to identify learning 
styles and effect ive modes of instruction. 

There has leen &ii pyer-increasing 
amount of literature concerning various 
teaching strategies, remedial approaches, 
and theories of learning style:- with 
LD students (L ner, 19Cx; Hresko 
& Read, 1981). However, th^re is 
1 ittle research available germane 
to s peci f i c vocati onal assessment 
techniques neccss-ary wth this popula- 
tion. Strategies and wsthodol ogies 
that produce positive results in 
the cl assroom may have questionabl e 
bearing on a student's work performance. 
Therefore, a unique t^chni cue-oriented 
approach must be implemented In vocational 
assessment that is specific to the 
LD student. According to McCray 
( 1982 ) , typi cal 1 y the comprehensive 
vocational eval uaiior center has 
a distinct eight-step syst°r>,atic 
approach. For the purposes of this 
paper , three steps require special 
considerations when assessing a LD 
student. These steps are orientation 
initial interview and formal 
testing/feedback. 

A majority of the literature 
has supported the position that a 
thorough ex pi a nation of assessment 
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procedures contributes to evaluee 
participation, reduces confusion over 
poor performances, and provides greater 
awareness for the benefits of the 
assessment process (McCray, 1982; 
Hursh, 1984). However, different 
methods of explanation promote a greater 
degree of comprehension with LD students. 
Depending on the specific learning 
disability, certain methods will not 
facilitate the student's comprehension 
of the assessment process. 

Consider this exampl e . It is 
the first day of the assessment process 
and all of the referred students are 
present. They are all male, fourteen 
years old, ninth graders, and diagnosed 
as LD. The referral information indicates 
that three of the students have auditory 
perceptual problems. Two other students 
experience shortened attention spans 
with visual perceptual problems. 
In addition, all eight students are 
tiysgraphic. With the myriad of known 
and possibly unknown learning disabilities 
present within this group, is it feasible 
to expect that a single method of 
explanation for the assessment process 
will promote participation, reduce 
confusion, or provide a learning exper- 
ience. 

The most ef fecti ve approach to 
providing all the students with a 
conceptualization of the assessment 
process requires an eclectic method. 
This method must incorporate a brief 
narration for students having visual 
perceptual problems , visual cues for 
students having auditory perceptual 
problems and a variety in delivery 
to increase attention span. Specific 
techniques which address individual 
needs include (a) a brief explanation 
with introduction and inquiry as to 
perception of the (assessment) process, 
(b) a slide show (approximately ten 
minutes), and (c) an abbreviated tour 
of the assessment center. 

The rationale for the brief expla- 
nation of vocational assessment is 
to orient the students to the situation. 
Brevity in delivery is of prime import- 



ance. Students having short attention 
spans , in addition to auditory and 
perceptual difficulties, are not 
able to process all the information 
the evaluation specialist needs to 
impart to them. Seeking their perceptions 
of the assessment process promotes 
student involvement and dispels any 
misinformation that may have occurred 
during the initial phase of the orien- 
tation or from previously eval uated 
students . 

The need for a slide show permits 
variety in presenting an overall 
pi cture of the assessment process. 
It also allows the students time 
to adjust to the environment without 
having any immediate demands being 
pi aced upon them. Furthermore, the 
si ide show is a rather concrete portrayal 
of the expectations of the assessment 
process. It should not be a commercially 
marketed product. Students are not 
interested in slides showing examples 
of vocational assessment to job placement, 
or slides showing adul ts being evaluated. 
A si ide show devel oped in- house is 
a more ef feet i ve means for rel ayi ng 
the purpose of assessment. The slides 
shoul d show exampl es of work sampl es 
which the students will be required 
to perform on with subsequent slides 
showing a "real-worl d" situation. 
For example, a slide showing a student 
performing on the Val par Whol e Body 
Range of Motion work sample should 
be fol 1 owed by a si i de showi ng a 
student working overhead on an automo- 
bile. This decreases the student's 
perception of assessment as being 
abstract and useless. 

Providing a brief tour of the 
center permits the students to recognize 
the work samples from the slide show 
and to formulate how they will interact 
wi th them duri ng the actual process . 
It also allows the student to become 
oriented to the physical plant and 
ask questions. 

A short fact sheet with the rules 
and regulations governing the operation 
of the center reinforces any previous 
comments. To assure that there are 
no misunderstandings concerning behavioral 
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expectations, it is best to review 
the fact sheet in a group setting. 

As a final item of note, there 
must be a distinction between the 
roles of the evaluation specialist 
and the special education teacher. 
The evaluation specialist's role is 
to simply interpret their vocational 
potential as it relates to learning 
styles, demonstrated aptitudes, instruc- 
tional modes and work behaviors. 
It is not to teach the student new 
vocational skills. Many of the LD 
students have been in the same 
self- contained classroom situation 
for a number of years and are aware 
of the special attention given to 
them. They may attempt to manipulate 
their environment and the evaluation 
specialist by feigning that their 
learning disability prevents them 
from performing in the instructed 
manner (Kl einhammer-Framil 1 , Framill , 
Schrepel, & Davis, 1983). To assist 
LD students to adjust to the work 
environment, they should be made aware 
that they will not be identified as 
learning disabled upon securing employment. 

Perhaps the most teuious task for 
the LD student is the written initial 
interview In the example of all 
eight studu.its experiencing dysgraphia, 
this is a particularly difficult request. 
An effective manner in facilitating 
the student 5 s responses to the questions 
is to verbally recite each item. 
Having an evaluation aide present 
to provide individual assistance is 
extremely useful. If the extent of 
a student's difficulties appear to 
the degree that one or more are lagging 
far behind the group, an oral interview 
is more appropriate. Having a chalkboard 
readily available allows the evaluation 
specialist to assist with spelling 
difficulties. Items on the chalkboard 
which can be of particular use are 
the current date, the correct spelling 
of the high school that the students 
attend, their bus number, the evaluation 
specialist's name, and the schedule 
for lunch and break. 

There are few commercially available 
assessment tool s which appropriately 



address the vc rational potential 
of the LD student. Vocational assessment 
within the school .-.etting must rely 
on modification* and ada^ive measures 
to provide adequate, valid assessment 
services. Sor ? of these modifications 
include the use tape- recorded 
instructions , equi pm<-nt that visually 
matches the instructional material, 
a highly structured assessment environ- 
ment, and use of the VITAS, TAP and 
COATS work sample systems. Students 
diagnosed as experiencing visual 
perceptual problems cannot be expected 
to perform wel 1 on work sampl es requiring 
the use of wri tten instructions. 
This becomes a monumental task, parti- 
cularly wi th the student havi ng a 
lack of vi sual sequent i al memory . 
A practical measure to alleviate 
the detrimental effect of the students 
speci f i c learning di sabil ity is to 
permit the use of tape-recorded instruc- 
tions. As with all modifications 
to the admi ni strati on of commercial 
work samples, the evaluation specialist 
shoul d not util ize publ ished performance 
cri teri a . Several standard psycho- 
met ri cs offer tape-recorded instruc- 
tions with their test booklets. 
One such example is the Bennett Mechanical 
Comprehension Test (BMCT) . Again, 
to assure that the vocational potential 
of the student is appropriately assessed, 
the development of locally gathered 
norming data is strongly encouraged. 
In furthering thp objective of assessing 
the LD student as accursedly as possible, 
providing equi pment chat vi sual ly 
matches the ins .ructi onal material 
cannot be stressed too strongly. 

Students having visual perceptual 
pro bl ems may rt ly on visual cues 
to cope with their environment. 
A good example is a work sample which 
requires hand tools, such as the 
COATS smal 1 engine servicing work 
sampl e . The audiovi sual i nstructions 
show a red-handled screwdriver being 
used to remove an oil plug. If a 
student with visual perceptual problems 
is subsequently given a yellow-handled 
screwdriver duri ng his assessment, 
he may request assistance because 
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he used the red handle as a visual 
cue . 

Another problem for the LD student 
which is typical of most young adults 
is the need to socialize. LD students 
are generally not aware of subtle 
social cues and particularly, are 
not sensitive to appropriate work 
behaviors. Often a student becomes 
distracted by external stimuli and 
cannot adjust to the freedoms of the 
assessment center. As a result, the 
student requires a closely supervised 
environment. A compensatory method 
is to invest in movable sound screens 
or design the center with a "quiet 
room" -to isolate and separate the 
students . 

Finally, there is the need to examine 
the appropriateness of commercially 
available work sample systems. Most 
of these systems do not have performance 
criteria for the LD student. However, 
the extent of modification required 
for the VITAS, TAP, and COATS systems 
is minimal . 

The VITAS system provides a one-time 
practice before independent performance. 
The assessment specialist should develop 
parallel practices and gather norming 
data. Further, the student 1 s conceptuali- 
zation of the task may be extended 
with an explanation from another student. 

The TAP system's appropriateness 
can be enhanced with practice and 
re-administration of the work samples. 
In this manner, the assessment specialist 
can extrapolate info nation as to 
some degree of separation of learning 
from performance. Although the COATS 
system utilizes an audiovisual format, 
it provides the student with an array 
of occupational information. An 
audiovisual format may pose certain 
problems for the LD student. Nonetheless, 
providing a replay unit and a manual 
with individual frame instruction 
can minimize most problems. This 
combination of work sample systems 
should aViOw the evaluation specialist 
greater confidence in interpreting 
the vocational potential of the LD 
student. It by no means implies that 
these modifications need only be imple- 



mented and adequate systems of measure 
are readily available. 

At the present there are no assessment 
systems developed specifically for 
the LD student. As che impact of 
Federal regulations defining learning 
disabil ities as a handicapping condition 
permeates the fields of rehabilitation 
and education, assessment tools will 
have to be developed accordingly. 

The i ntent of thi s paper was two 
fold. First, it was to alert the 
evaluation specialist to techniques 
which are currently appl ied in vocational 
assessment of LD students. Second, 
to show the deficit in the designs 
of commercial ly avail abl e systems 
when used with the LD population. 
The eval uation special ist must seek 
out, develop, and val idate in- house 
methodologies until adequate systems 
become available. 
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A MODEL VOCATIONAL EVALUATION PROGRAM 
FOR THE LEARNING DISABLED ADULT 



PAMELLA KICKS 
MARILYN LONG 



ABSTRACT: Traditionally, 1 earni ng 
disabilities (LD) have been viewed 
as handicapping conditions remediated 
upon compl eti on of the educati onal 
process. However, current 1 iterature 
indicates that there are life-long 
vocational and social implications 
for the LD adult. Deficits in perceptual 
abilities, academic skills, and 
psycho-social skills typically hinder 
the LD adult in obtaining job-specific 
vocational skills which often result 
in unemployment or underemployment. 
In order to assess such limitations, 
a comprehensive evaluation is required. 
A cooperative effort between the Sparks 
Center for Developmental and Learning 
Disorders and Vocational Rehabilitation 
Services (VRS) has resulted inwholistic 
model utilizing an interdisciplinary 
approach to assessment of the LD adult. 
Interdisciplinary consultation provides 
information concerning physical , medical , 
nutritional, language, hearing, visual, 
educational , psychol ogi cal , social, 
and vocational aspects. The variety 
of measurement instruments employed 
yield information regarding psycho-social 
skill s , perceptual organization, literacy, 
and language function as well as worker 
skills and work habits. Collaboration 
between the Sparks Center team, the 
VRS counsel or , the indi vidual , and 
the family enhances the overall effective- 
ness of vocational planning for this 
target population. 



Through the years ? handicapping 
conditions have been of concern to 
a variety of health and human service 
professionals. Research regarding 
the impact of these conditions on 
all aspects of exception to this 
has been the research pertaining 
to 1 ife-long impl ications of speci fic 
learning disabilities. Si nee the 
I960 1 s , substantial resources have 
been directed toward the learning 
di sabl ed (LD ) popul ati on ; however , 
this has occurred largely within 
educational settings. Indeed, learning 
di sabil ities have traditionally been 
considered educational ly handicapping 
condi tions of chi 1 dhood . However, 
professionals in the human services , 
most notably rehabil i tat ion services , 
have become increasingly aware of 
the frequently mul ti tndi nous obstacles 
faced by tne LD adult. Deficiencies 
in intellectual functioning, perceptual 
abilities, social skills, academic 
achi evement , and personal maturi ty 
have hindered LD adults in successful 
vocational and social adjustment 
(Cronin & Gerber, 1982). LD adults 
have typical ly experienced underemployment 
or unemployment as a result of such 
dysfunctions. This has posed a need 
for a comprehensive or wholistic 
model of vocational evaluation subsequent 
to vocational planning for LD adults. 
In an effort to identify and respond 
to the various needs of 1 earni ng 
disabled adults, a cooperative effort 
between the Sparks Center for Develop- 
mental and Learning Disorders and 
Vocational Rehabil i tat ion Services 
(VRS) has resulted in such a wholistic 
model of assessment for the adul t 
learning disabled population. 

The Adult LD Project at the Sparks 
Center has based its servi ces on 
a multi disci pi inary approach to assess- 
ment. Though the major focus of 
the Project has been adjustment oriented, 
vocational eval uation has provided 
the basis for vocational planning 
and subsequent adjustment/transitional 
services. The whol istic model employed 
in vocational eval uat i on has drawn 
upon a wide spectrum of expertise 
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at the Sparks Center. LD team members 
have consulted with the Divisions 
of Psychology, Social Services , Nutrition, 
and Vision Function regul arly. Additional 
consults have been provided by other 
divisions as necessary: Medicine, 
Speech and Hearing, Physical 
Therapy/Occupational Therapy. Information 
from these disciplines has provided 
an extensive data base for more in-depth 
assessment of functional assets and 
limitations as related to vocational 
success. 



Review of Literature 

A review of literature has indicated 
various factors contributing to successful 
school and vocational adjustment. 
These factors included social adjustment, 
vocational training, and academic 
competencies. However, the LD adult 
continued to manifest deficits in 
each of these areas. 

Sherbenou and Holub (1982) stated 
that academic deficits (reading, math 
written language, spoken language) 
were common in all LD adolescents. 
These academic deficits persisted 
in adults (Blalock & Dixon, 1982) 
thus interfering with social and vocational 
success (Faford & Haubrich, 1981) 
since they influenced future training 
and employment. 

Although some LD adults developed 
appropriate social skills and positive 
sel f- concepts , emoti onal instabil ity 
was a major manifestation in LD admits 
(Blalock & Dixon, 1981); Sherb-nou 
& Holub). Emotional turmoil was cften 
reflected in unemployment or under- 
employment (Crimando & Nichols, 1982). 
Deficiencies in social perception 
frequently acted as a catalyst for 
problems in interpersonal relationships 
(Axelrod, 1982; Kinskoff, 1980; Sherbenou 
& Holub, 1982; Wanat, 1983) which 
threatened successful vocational and 
social adjustment. Indeed, many (Kronick, 
1978; Lerner, Evans and Meyers, 1977) 
bel ieved poor social adjustment to 
be more disabling than academic dysfunc- 
tions in LD adults. 



In addition, LD adults were often 
occupational ly immature since their 
exposure to career education was 
limited or non-existent. As a result, 
the LD adult f requentl y developed 
unreal i stic vocational as pi rations 
due to unfamil iarity with basic job 
requirements. If a real istic vocational 
choice were designated, though, the 
LD adult often demonstrated ineptitude 
in developing plans to attain those 
aspirations. This indicated the 
need for career awareness and vocational 
counsel ing for successful transition 
to adult life for the learning disabled 
(Fafard & Haubrich, 1981; Lerner. 
et al . 1977; Sherbenou & Holub, 1982). 
Si nee career knowl edge as wel 1 as 
academic and social competencies 
greatly infl uenced vocational success 
(Cronin & Gerber, 1982), various 
assessment needs were identified. 



Since a learning disability 
was such a multi-dimensional condition, 
eval uations were requi red by various 
disciplines to identify the particular 
traits manifested by the LD adult. 
Cronin and Gerber (1982) suggested 
that this eval uation process consist 
of medical examination, a psychological 
asressment, a social assessment, 
a no educational testing, in addition, 
a vocational assessment was considered 
a critical facet in this evaluation 
process sim:e it assessed vocational 
interest, aptitude and work traits. 
This interdiscipl inary approach to 
assessment required measures of adaptive 
behavior (Patton & Polloway, 1982), 
social skill s, vocational academics , 
end functional daily 1 i ving skills 
.(Sherbenou & Holub, 1982.) In addition, 
the use of work sampl es (commercial 
and informal and behavioral observation 
was recommended in assessing work 
related skills and functional competen- 
cies. Information from such an inter- 
disciplinary approach coul d then 
be utilized in career/ vocational 
planning with LD adults (Cronin & 
Gerber , 1982; Sherbenou & Hoi ub, 
1982.) 
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Description of Nodel 

As stated previously, the Adult 
LD Project at the Sparks Center routinely 
utilized assessment techniques offered 
by the Divisions of Psychology, Social 
Services, Nutrition, Vision Function, 
and Special Education/Vocational Rehabili- 
tation. Consultation was provided 
as needed with the other divisions. 
Each division has identified a variety 
of standardized and informal measures: 

Division of Psychology - Wais-R, MMPI, 
Zung, Beck 

Division of Nutrition - completion 
of informal food intake 

Division of Vision Function - assesses 
visual acui ty , Bender Gestal t , 
Test for Visual Analysis Skills, 
Money Road Map Test, Koppitz Visual 
Aural Digit Span Test, Getman-Hender- 
son-Marcus Visual Memory Test, 
Test for Auditory Analysis Skill s , 
King-Devick Saccade Test 

Division of Special Education/Vocational 



Rehabilitation - Wide Range 
Achievement Test (WRAT), Stanford 
diagnostic Reading Test (SDRT), 
Stanford Diagnostic Mathematics 
Test (SDMT), an informal written 
language assessment, Microcomputer 
Eval uation and Screening Assessment 
(MESA) , sel ected work sampl es 
from the Valpar Component Work 
Sample Series 

Division of Social Services - a compre- 
hensive social services interview 



The Adult LD Project evaluation 
required four to six days. A group 
of four referrals was able to proceed 
through the eval uation. Divisional 
information obtained from the various 
assessments Was utilized in determining 
the presence of a learning disability 
and the implications of the learning 
disabil ity on the subjects personal 
and vocational competencies ^See 
Figure 1). 
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The Division of Special Education/- 
Vocational Re ha bi 1 i tati on (SE/VR) 
initiated the evaluation process by 
providing a brief orientation to the 
activities to be encountered in the 
LD Project evaluation. Included in 
this orientation was a brief discussion 
of learning disabilities and their 
vocational impl i cations. After this 
informal orientation, testing was 
then initiated util izing the Microcomputer 
Evaluation and Screening Assessment 
(MESA). Administration of the MESA 
yielded information regarding functional 
academics , eleven different aptitudes , 
tool use, physical mobility, general 
strength, vocational interest and 
awareness, and speaking skills* A 
worker profile was then generated 
from the preceding information. This 
profile was then utilized the following 



day in an LD Project prestaf f ing 
to identify assessments or consultations 
required with other divisions and 
to determine appropriate work samples 
for further testing. 

The clients then saw the Division 
of SE/VR and the Division of Social 
Services on the third day. The Division 
of SE/VR conducted academic testing 
that yi el ded i n format i on regardi ng 
the type of trai ni ng and empl oyment 
the client would be able to obtain 
as well as proficiency in independent 
living skills (banking , budgeting , 
consumer shopping, completing job 
applications, etc.)* That afternoon, 
the division of Social Services conducted 
an intake interview to obtain information 
regarding medical history, educational 
traini ng , work hi story , and social 
involvement. Social ski 1 1 s are observed 
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and any expressed anxiety or depression 
was further explored. 

The next two days vsre once again 
devoted to testing with the Division 
of SE/VR to administer selected work 
samples from the Val par Component 
Work Sample Series. The work samples 
yielded, information regarding work 
behaviors and work skills. In addition, 
the Division of Vision Function performed 
evaluations that assessed visual acuity 
and visual perception. 

The Division of Psychology and 
the Division of Nutrition were assigned 
the last day of the evaluation. The 
Division of Psychology provided intel- 
lectual functioning and personality 
factors such as depression, stress, 
anxieiy, or aberrant behavior that 
may interfere with successful job 
performance. That afternoon, the 
Division of Nutrition completed an 
intake fo:^ regarding the client's 
nutritional ^atus. 

The subsequent week of an LD 
evaluation, test results were reviewed 
in a staffing to determine the presence 
of a learning disability. In addition, 
the impl ications of the 1 earning disabil ity 
on the client's vocational aspirations 
was discussed. LD Project staff would 
then develop recommendations regarding 
adjustment services, job readiness 
training, vocational objectives, and 
job placement. The evaluation results 
and recommendations would then be 
relayed to the client in a conference. 
The VRS counselor, the parent, and 
staff members from other disciplines 
were invited as needed. The VR counselor 
then utilized the evaluation results 
and recommendations to develop vocational 
objectives and formulate an Individually 
Written Rehabilitation Plan (IWRP). 

Sumary and Critique 

Although this model provided 
critical information for diagnosis 
and vocational planning, it was evident 
that some changes were necessary. 
The cumbersome sequence of interdis- 
ciplinary e val uat ions was often confusing 
to clients as well as team members. 



Further, a number of referrals to 
the project were later found to be 
not LD yet extensive resources were 
utilized in a comprehensive assessment. 
Many of these clients were more appro- 
pri ate for pi a cement el sewhere for 
these services. Also refinement 
in assessment techniqueswas initiated. 

Al though the program continued 
to utilize a two week timetable for 
evaluation, a primary alteration 
occurred in the sequence of inter- 
disci pi inary assessments (see Figure 
2). 

Other refinements in the evaluation 
process included changes in the edu- 
cational measures util ized for assessment 
of academic achievement: The Test 
of Written Language (TOWL) was substituted 
for the informal sampling of written 
language and the WRAT was eliminated 
for further streamlining. In addition, 
vocational testing began the following 
week with administration of the MESA. 
After MESA testing concluded, an 
i nterdi sci pi inary staffing occurred. 
Review of assessment results, diagnosis 
of cl ients , and recommendations comprised 
the staffing agenda. Non-LD clients 
were remanded to VRS for further 
assessment services. Clients diagnosed 
LD returned for further vocational 
assessment. Interpretive conferences 
to review evaluation results as well 
as recommendati ons were schedul ed 
for cl ients regardless of the diagnosis. 
Though these refinements have increased 
the ease and qual ity of vocational 
evaluation through the LD Project, 
additional changes are anticipated. 

The adult LD Project uti 1 ized 
the i nterdi sci pi i nary assessment 
suggested for LD adults in literature. 
The pervasi ve nature of a 1 earning 
disabil ity necessitated a mul ti disci- 
pi inary assessment. This multidisci- 
pl inary approach provided vital infor- 
mation regarding social networks 
and psychosocial stressors as well 
as other vocational assets and limita- 
tions. Results may be utilized in 
vocational planning and transitional 
services to effect successful employment. 
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A WORK MEASUREMENT APPROACH TO FUNCTIONAL 
ASSESSMENT 
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ABSTRACT: The work oriented human 
service industry has grown out of 
the current emphasis on projects with 
industry, transition programs, economic 
pressures on facilities to develop 
work oriented client programming, 
supported work and job placement. 
These developments have required evaluators 
to place a high priority on the relation- 
ship of assessment results to external 
work placement. Thus, there is need 
for evaluators to have techniques 
and skills in Work Measurement and 
Functional Assessment. 

This paper will examine an industrial 
engineering approach to Work Measurement 
(MODAPTS) and its functional assessment 
component (Workabil i ty) . It wil 1 
present a method in which a precise 
approach to the following questions 
can be util ized. 

1. What is the handicapped person's 
performance i n rel ati onshi p 
to employer requirements? 

2. What is the degree of deficit 
in various work tasks? 

3. What is the most efficient 
method of performance for 
the person doing the task? 

4. What are task performance 
requirements for jobs in the 
workshop and/or community? 

5. How does the eval uee 1 s performance 
profile compare to industrial 
requirements? 



Since 1909 (Maynard, 1971) engineers 
have utilized stopwatch time study 
and predetermined time standards 
to measure work. Engineers have 
used work measurement to determine: 

1. reasonable time for a person 
to carry out a defined task; 

2. a reasonable amount of output 
for the person performing 
the task; 

3. the most efficient method 
of performance for the person 
doing the task. 

A predetermined motion time 
standards system (PMTS) (i.e. MODAPTS, 
MTM , Work Factor , Standard Data) 
is an advanced work measurement technique 
whereby establ ished standard data 
for basic human motions are calculated, 
resul ti ng i n standard time required 
for the performance of various opera- 
tions. As an alternative to traditional 
stopwatch time studies , the PMTS 
approach reduces subjectivity in 
evaluating an individual's performance 
relative to that of a trained, experienced 
worker. 

Duri ng the past decade rehabil itation 
professionals and industrial engineers 
have recognized the value of work 
measurement techniques in the assessment 
of handicapped individuals workplace 
capabilities. Shinnick and Black 
(1983) proposed the use of work measure- 
ment and methods engineering techniques 
in vocational eval uat ion process. 
In Australia the founder of MODAPTS 
(Modular Arrangement of Predetermined 
Time Standards) published Workability, 
(Heyde , 1974) , the functional assessment 
system examined in this paper. In 
1975 the I nter national Methods Time 
Measurement (MTM) Directorate suggested 
that a project be undertaken to develop 
a system to aid the rehabilitation 
of handicapped and disabled people. 
This effort resul ted in the Mast 
System (Wilcock, 1984). These develop- 
ments strongly indicate the perceived 
need for the application of work 
measurement to evaluation. 

Throughout the worl d eval uators 
have accepted MODAPTS and Workability 
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as a valid and useful PMTS and work 
capabil ity assessment tool (Sherrington, 
1978; Yokomozo, 1980; Bootle, 1978; 
Brolin, 1981). For many of the same 
reasons industrial engineers and the 
world industrial and commercial communities 
have accepted and utilized MODAPTS. 
They have found the 21 motion elements 
in MODAPTS and the 69 motion elements 
for clerical and transit work in MODAPTS 
Plus (Heyde, 1983) to be quicker and 
easier to learn than the 400 elements 
of Methods-Time-Measurement (MTM) 
and the 150 elements of Master Standard 



Data [MSD). According to Shervington 
(1978): 

•'Most of the consumers of our 
Wo? ► assessment services: direct 
nts and clients), indirect, 
>rs, lawyers, and insurance 
a„ ^s), are able to understand 
the gon of this workplace and 
br ' method of assigning values 

t' ts that make up tasks expected 

ot peoj- at work." 

The most obvious feature of 
MODAPTS is its fundamental simplicity. 
MQDAP7S is based on the principle 



figure 1 
*The MODAPTS PLUS Card 
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that all body movements can be expressed 
in terms of multiples of a simple 
finger movement. The units of time 
adopted for use in MCDAPTS are called 
MODS. The value of a mod is 129 milli- 
seconds, which is also the a same 
as a 0-129 finger move (coded Ml)* 
A hand move becomes an M2 (2x0.129 
seconds), a forearm move is an M3 
(3x0.129), and a whole arm move an 
M4 (4x0.129). Likewise, a foot move 
is F3 (3x01.29), an eye use is E2 
(2x0.129), and a bend and rise is 
B17 (17x0.129). 

The elements in MODAPTS PI us 
(Heyde, 1983), represented by boxes 
with pictures of body parts, alphabetics 
and integers, encompass nearly all 
of the physical activities by which 
peopl e carry out work. The MODAPTS 
Plus card in Figure 1 depicts rows 
and columns of boxes. Each column 
has the same integer value such that 
the first column has zero value, column 
two has a value of one, etc. Likewise, 
the lines across have some "family" 
connection. The boxes on the first 
line are 'gets"; on the second line 
"puts", and on the sixth line of boxes 
are elements not elsewhere included, 
where eye use is a major factor. 

Users of the system identify 
the body part(s) used to carry out 
some action or series of actions. 
It they are fluent in the system they 
recall what the elements are, write 
them down, add them up, multiply by 
the frequency, divide by 7, and give 
the standard time in seconds. In 
many cases a simpl e standard can be 
produced by a fluent individual in 
a few minutes . 

Users who are less fluent have 
to look up the definitions of some 
of the elements, hence, writing a 
standard takes longer. Learning the 
system takes four days, two 2- 1/2 
day training programs is ideal. After 
learning the system, another forty 
hours is required to develop fluency. 

Workability with MODAPTS (Heyde, 
1974) provides a series of comparatively 
simple assessment tasks that measure 
the functional capabilities of workers 



(particularly those with some known 
impairment) and then compares them 
against the standard performance 
of a "normal" person. The assessment 
battery consists of 21 work tasks 
that are rel ated to the MODAPTS el ements . 
The Workability assessment tasks 
can be admini stered in approximately 
two hours. 

The results of Workability are 
reported in a profile that compares 
the evaluee's performance against 
the MODAPTS standard for that task 
or set of tasks. The results can 
be further verified through the use 
of simulated tasks and job trials 
(Shervi ngton , 1974) . Workabil ity 
can be utilized to assist with the 
following: 

1. Placement of people on tasks 
that maximize their strengths; 

2. Training of workers in areas 
of identified performance 
deficiencies; 

3. Job redesign to minimize 
worker deficiencies or maximize 
strengths; 

4. Job modifications to increase 
worker performance; 

5. Determination of performance 
loss due to injury through 
the MODAPTS analysis of tasks 
or jobs performed pri or to 
impairment compared to Workabil ity 
assessment post-injury. 

Assets and Current Limitations of 
Workability 

Workability may be considered 
a form of functional assessment, 
which has been defined by Miller 
and Mulkey (1983) as "a systematic 
process of identifying and quantifying 
an individual 1 s rehabil itation potential 
for a given occupation." Functional 
assessment can be di sti ngui shed from 
a physical capacity evaluation which 
has been defined by Harrand (1982) 
as "a systematic assessment of physical 
performance and performance potential 
by a qualified and medically educated 
professional ." Workability measures 
functional skills that reflect actual 
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components and movements of work which 
can relate to a specific job. By 
measuring specific skills required 
for successful industrial performance, 
Workabil ity provides functional information 
that can be generalized to many work 
areas, but particularly production 
oriented work. This can allow the 
identification of functional skills 
thai: need improvement or possible 
job modification. 

Workability has many assets which 
favor its usage as an evaluation tool. 
Workability can provide a quick (2 
hour), inexpensive (under $500) and 
easily learned system for the initial 
screening or measurement of the degree 
of progress of clients, particularly 
those cl ients with physical disabil ities. 
Due to the short testing time, Workabil ity 
would work well as an assessmei-.t of 
learned skills or physical improvement 
of a client while in a rehabilitation 
center or work center. 

A primar;- advantage of Workability 
has beer; the assessment of functional 
sk^ll^ that reflect actual components 
and movements of work. By evolving 
from an original work measurement 
system (MODAPTS), Workability assures 
that it is directly related to skills 
that are involved with work. 

Workability also has the potential 
to establ ish a cooperative and productive 
relationship between production and 
evaluation. By being based on a work 
measurement system, and measuring 
motions of work, there is greater 
face validity for production staff 
(particularly compared with psychometric 
testing). This can encourage the 
involvement of production staff in 
the evaluation process and provide 
a common language for i nformation 
exchange between evaluation and produc- 
tion. This can also encourage the 
evaluator to develop a greater awareness 
of production standards and work skills. 

A unique aspect of Workability 
invol ves the measurement of physiological 
effects (pulse) of heavy work activity 
and the concept of work capability. 
Physiological measurement can provide 
an estimate of energy expenditure 



which may be required for heavy work 
and suggest possible job restrictions 
or medical follow-up. An additional 
concept which is unique to Workability 
has been termed capability. This 
compares an inch" vidual 1 s performance 
on an unskilled activity with the 
performance of a normal worker. 
Since the activity is unskilled, 
the individuals performance can be 
assumed to measure his/her physical 
capability and the resulting percentage 
will reflec. that person's capability 
to do the task provided the individual 
is motivated, 

Workabil ity concentrates primarily 
on the screening of dexterity related, 
repetitious tasks, it also includes 
components such as motivation, clerical 
skills and reading which are related 
to a broader range of jobs . The 
tests of reading, math and writing 
are 1 imi ted in scope , but can serve 
as screening tests until more diagnostic 
tests are administered. As a screening 
device, it serves to complement the 
more thorough eval uation tool s such 
as work sampl es , situational assessments 
and job tryouts. 

The Workability system could 
be improved by modifying the manual. 
Currently, the instructions and inter- 
pretations of results are not explicit 
and leave considerable room for evaluator 
speculation. This is, particularly 
evi denced by the norms whi ch provi de 
only the "expected time" for completion 
of the task. With fluency in MODAPTS, 
the percentage of normal time can 
be determined for norms, but this 
coul d be suppl ied in tabl es for the 
evaluator's convenience, The use 
of terminology such as "good" time 
on some tests increases this difficulty 
in interpretation. 

Workabil ity primarily emphasizes 
speed of work and not quality. Quality 
of work and scoring of errors are 
discussed on several tests, but this 
reasoning is vague and for most tests 
it is an "all or none 11 proposition 
for quality scoring. Quality and 
speed scoring are also combined such 
as in the math test in which 5% is 
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added to the time score for each incorrect 
digit. This again decreases the emphasis 
on quality by not separating the two 
scores. 

The shortness of many of the 
tests also leads to some questions 
concerning reiUbility. Of particular 
concern are the tests which may involve 
considerable learning after one adminis- 
trator. This is demonstrated in Test 
18 in which the client is timed on 
looking up one telephone number. 
Retestingmay be significantly influenced 
by the previous administration, but 
the manual does not mention any concern 
and interpretation is again difficult. 

A revised manual that provides 
more explicit instructions, norm tables, 
scoring sheets and performance quality 
guidelines will be available through 
Auburn University in Winter, 1985. 
The manual will be a companion piece 
to a portabl e Workabil i ty Kit that 
will include all of the equipment 
required for the 22 tests. 

Utilization of Workability in Service 
Delivery 

Predetermined time standards 
used in assessing individual capabil ities 
offer the vocational rehabilitation 
specialist quantitative and objective 
information to serve as benchmarks 
in comparing client performance and 
job task requirements. The 22 tests 
within Workability provide data which 
assists in identifying the ability 
range of the client. This performance 
data can provide valuable input to 
the reha bi 1 i tation team in improving 
specific functions, redesigning tasks 
for the individual and comparing the 
individual's functional movement capabi- 
lities with the analysis of available 
employment opportunities. 

Appl i cations of Workabil i ty in 
Australia have demonstrated that the 
information gained from these workplace 
capability tests is enhanced when 
used in conjunction with other methods 
of assessment. Specif ical ly, situational 
assessment, work simulation and community 
work trial s have been found to effectively 



complement the Workability testr 
(Shervington , 1978)* Because the 
el ements measured in the assessment 
tasks can be readily compared to 
the different activities of piecework 
or other repetitive tasks, production 
impediments can often appear cl earer 
resulting in more likely remediation. 
For example, a client capable of 
achieving 75% of standard time in 
a Workability test measuring certain 
manual movements may be performing 
tasks in a facil ity work center util izing 
the same movement patterns, yet only 
achieving 50% in actual production. 
Program staff and production personnel , 
after reviewing the cl ient' s Workabil ity 
prof i 1 e , may be batter prepared to 
advise the cl ient toward maximizing 
this 75% capacity. Individual s may 
likewise be assigned to work tasks 
which emphasize programmatic gai n 
and accelerate pro duct ion output 
thereby al leviating a source of internal 
conf 1 i ct common to many production 
oriented re ha bi 1 i tation programs . 
Implicit in the Workability assessment 
approach is thi s . positive focus on 
worker strengths. Increase in wages 
resulting from individual productivity 
gai ns subsequently reinforce work 
motivation for the great majority 
of cl ients. 

Another no :abl e advantage to 
staff performance nes in the development 
of a basic orientation to industrial 
engineering concepts through an under- 
standing of Workability and MODAPTS. 
Counsel ors and other adjustment personnel 
quickly demonstrate greater familiarity 
with underlying principles of tasks 
analysis, job analysis and vocational 
exploration activities. 

Benefits derived from the adoption 
of MODAPTS techniques in concert 
with Workability assessments are 
perhaps most obvi ousl y rel evant to 
the concerns of work supervisors 
and production managers. The MODAPTS 
system, upon which Workability is 
founded , all ows for more accurate 
(Riesel & Roll, 1977) and less time 
consuming establ ishment of work standards 
in contrast to traditional stopwatch 



103 



time study methods. Research conducted 
by Price Waterhouse in industrial 
situations demonstrated that standards 
for normal work operations can be 
produced at the rate of 20 or more 
daily (Colbert, 1970). Computeriazation 
of standard setting through MODAPTS 
further expendits the process through 
availability of "user friendly 11 software 
for IBM, Apple and Radio Shack micro- 
computers. One exceptional software 
feature is a program that yields rest 
and recovery allowance information 
for work tasks. This el iminates subjective 
al 1 owance factors or across-the-board 
rati ngs which do not consider other 
fatiguing conditions that may be inherent 
to the task. The process thereby 
1 ends a more accurate estimate of 
direct labor costs and the establishment 
of fair wage rates. 

Awareness of the time values 
associated with each element fosters 
sound thinking in work layout practices 
as well as the design of jigs and 
fixtures to minimize difficulty of 
task and energy expenditure. By analyzing 
the overall profile of facility caseload 
capabilities, production staff can 
more effectively focus on specific 
sub-contracting and prime manufacturing 
endeavors. In general terms, the 
techniques and phi 1 osophy of the MODAPTS/- 
Workability approach to rehabilitation 
production management can serve to 
maximize overal 1 work center productivity 
levels on existing tasks and expand 
production capacities for new tasks. 

Finally, in consideration of 
the potential enhancement of rehabili- 
tation service, attention is directed 
toward a growing Federal-State priority 
for job placement. The objective 
verification of job readiness through 
proven performance in like tasks increases 
the client's prognosis for a successful 
outcome when placed in community employ- 
ment . 

Hence , the MODAPTS/Workabi I ity 
approach to work measurement can provide 
assistance to a spectrum of facility 
personnel i ncl udi ng eval uators , adjustment 
staff, production personnel and placement 
specialists. Perhaps the most salient 



contribution to be derived from our 
profession's potential evolution 
toward this advanced system of analyzing 
work will be the development of a 
common language among different roles 
in vocational service del i very (Shinnick, 
1985 ). The reader siiould note that 
Workability is not only a system 
for the rehabilitation of clients 
with physical disabilities, albeit 
the possibilities for new horizons 
in this area are promising, it is 
also • approach to planning, measuring 
and descri bi ng work which affords 
a new dimension in functional assessment 
of work capabil ities regardless of 
disabil ity. 
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FURTHER DEVELOPMENT OF TI!E VOCATIONAL 
DECISION-MAKING INTERVIEW FOR HANDICAPPED 
POPULATIONS 



THOMAS CZERLINSKY 



ABSTRACT: The research investi gation 
considers the complex issues facing 
cl ients and students when making vocational 
decisions . Using an instrument developed 
earlier by the Research and Training 
Center at the University of Wisconsin- 
Stout, the vocational Decision-Making 
Interview (DMI), this investigation 
sought to examine the effect that 
vocational evaluation may have in 
changi ng vocational deci si on -ma king 
capacities and to determine the stabil ity 
of the DMI scores ever a time period 
of one week. 



Many clients receiving vocational 
rehabilitation services must make 
some major decisions concerning their 
vocational future. Li ke nonhandicapped 
individuals, such clients vary greatly 
i n their abil ity to make vocational 
choices and decisions. They can 
range from those who have made a 
vocational decision and are actively 
pursuing that choice, on the one 
hand , to those who 1 ack the skills 
required to go about acquiring infor- 
mation, making a vocational decision, 
and/or impl ementing that decision. 
This end of the continuum may display 
the "indecisive personality" (Holland 
and Holland, 1977). In addition, 
however, compared to non- handicapped 
individuals, clients may have somewhat 
more difficulty inmaking such decisions, 
because of the limitations imposed 
upon them by their disability, and 
because of the 1 i mi ted peri od of 
time that they receive rehabilitation 
services . 

The issues involved in vocational 
decision-making , and the probl ems 
surrounding these issues, have beer, 
widely studied, and cover a broad 
s pectrum . An extens i ve revi ew of 
these issues can be found in a number 
of sources (e.g., Czerlinsky et.al , 
1982). An important point needs 
to be made concerni ng these studies , 
however. And that point is, while 
vocational decision-making and vocational 
indecision is relevant to all individuals 
(i ncl udi ng rehabil itation cl ients) , 
most of the research addressing these 
areas has considered only high school 
and college populations (Fugua and 
Hartmen, 1983; Hartman, Fugua, and 
Hartman, 1983; Taylor and Betz, 1983; 
and Thorensen and Ewart, 1979). 
Rehabilitation clients have been 
studied very little in this regard. 
In fact, there is little literature 
available dealing with the vocational 
choice problems of special populations 
in general (Phil 1 i ps , Strohmer , Berthaume, 
and 0' Lea ry, 1983) . Considerable 
work has been done in the area of 
vocational choices, yet only a few 
articles (e.g., McCarthy, 1983; Holder, 
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Friel, and Tyler, 1979; and Rosenberg, 
1979) have dealt specifically with 
special populations served by rehabili- 
tation. Phillips, et.al. points out, 
in addition, that despite some increase 
in studies dealing with special popu- 
lations since 1975, caution must be 
used in interpreting some of these 
studies, since they may be based upon 
i nsuf f i ciently founded assumptions 
and/or weak and inadequate research. 
Thus, little is in actuality known 
about the vocational decision-making 
problems of these special populations, 
or about possible remediation or treatment 
strategies directed toward these problems. 

There is a definite need in vocational 
rehabilitation and special education 
to consider the complexities which 
clients and students face in making 
vocational decisions. Such individuals 
receive a variety of services which 
deal specifically with this area, 
yet there is no real adequate means 
for effectively assessing these special 
populations in this realm. For example, 
one service that is directed toward 
the area is Vocational Evaluation, 
a service that is concerned with syste- 
matically gathering client information 
for planning and prediction purposes 
in the vocational realm. In addition, 
Vocational Evaluation ideally should 
use the information collected to determine 
what problems the individual may have 
in making vocational decisions, and 
to assist the person to make these 
decisions. To be an optimally effective 
service, Vocational Evaluation should 
enable the client to be an active 
participant in his/her rehabilitation, 
not an observer to a process in which 
he/she is involved. To do this, however, 
requires considerably more than collecting 
vocational aptitude data . It requires 
exploring with t.ie client or the student 
exactly what the strengths or weaknesses 
in making vocational decisions are, 
so that action can be taken to remediate 
any weaknesses which may be present. 
Although Vocational Evaluation has 
been si ngl ed out her these comments 
apply to a number of other services 
as wel 1 . 



A basic need in this area is 
to devel op a means by which service 
providers can effectively and efficiently 
pinpoint such areas. The development 
and use of an accurate tool for assessing 
rehabil i tat ion cl ient and special 
education student vocational decision- 
making strengths and weaknesses would 
enabl e service providers to pinpoint 
specific problem areas, and to develop 
strategies for the remediation of 
these difficulties. 

In a 1 ine of prior research 
conducted at this Center, such an 
instrument was developed, and reliability 
and validity tests were conducted. 
The i ns t rumen t -- the Vocational 
Decision-Making Interview ( DMI ) 
is an eighty-item structured interview 
addressing the very real day-to-day 
problems faced by handicapped individuals 
in making vocational decisions. 
The DMI_ items fall into three broad 
sub-seal es Em pi oyment Readiness , 
Self-Appraisal , and Decision-Making 
Readiness. The DMI is designed to 
be individually administered and 
read to a client. The client then 
responds whether , for him/her, the 
i tern i s true , whether it is fal se , 
or whether the client is not sure. 
Sample DMI items are appended. Pre- 
liminary results with the DM were 
encouraging, and are fully detailed 
by Czerlinsky, et.al., 1982; and 
Strohmer, et.al., 1984. Simply put, 
the initial version of the DMI showed 
very encouraging reliability and 
di scrimi nant val idi ty data . Indi- 
cators of i nternal consi stency of 
the scales showed that the three 
subscales indeed were adequately 
internally consistent. The validity 
criterion was that the three scales 
be able to di scrimi nate between two 
groups of clients chosen a priori 
to differ in level of vocational 
decision-making capacity. This criterion 
was met, in that clients entering 
Vocational Evaluation scored significantly 
lower than clients in vocational 
training. One caution with this 
between-groups design was that, since 
the subjects were different between 



the two experimental groups, facto/s 
other than those hypothesized (for 
example, selection factors that may 
influence which clients enter vocational 
training) may have had an influence 
upon the differences found between 
the evaluation clients and the training 
clients. The research presented below 
will address this, since the data 
is gathered in a pre-post test design. 
Readers interested in a closer inspection 
of the data gathered in the initial 
study should refer to the previously 
mentioned publications. 

In a current series of four research 
projects, the reliability, validity, 
and utility of the DMI_ is being further 
investigated. This series of studies 
is being conducted with vocational 
rehabil itation cl ients at Stout Vocational 
Rehabil i tation Institute's Vocational 
Development Center, and at several 
Special Education sites in three different 
states. Studies are investigating: 
1) the stability of Ml scores over 
varying intervals of time (and, in 
one study, with and intervening treatment 
directed at changing vocational de- 
cision-making capacity) ; 2) the concurrent 
validity of the DMI with independent 
ratings of the clients by professional 
evaluators working with the clients; 
and 3) the demographic characteristics 
of clients and students who may be 
particular types of vocational decision- 
making problems. The results presented 
in this paper are the first to come 
out of this series of studies. 



Methodology 

As described above, the data 
presented in this report stems from 
a number of ongoing studies. The 
primary study uti I ized here was concerned 
with testing vocational rehabilitation 
clients with the DMI as they entered 
the Vocational Development Center 
for evaluation. The same clients 
were then retested at the end of the 
i • week (evaluations at the VDC 
a^ of a one week duration). In addition, 
extensive demographic data was gathered 



on each client at the* beginning of 
the evaluation. 

Some of the purposes of this 
project were : 1 ) to i nvest i gate 
the effect that an active treatment 
(Vocational Evaluation) may have 
in changing vocational decision-making 
capacities, as indicated by changes 
on DMI scores; and 2) to determine 
the stability of DMI scores over 
a week's interval . 

Subjects 

The primary group of subjects 
yielding the data for the present 
report were ei ghty-si x vocational 
rehabil itation cl ients receiving 
Vocational Evaluation services at 
the Vocational Devel opment Center, 
the servi ce component of the Stout 
Vocational Rehabil itation Institute. 
The subjects were randomly sampled 
from the popul ation of cl ients receiving 
these servi ces . The only deviation 
from the random sampling was that 
scheduling constraints ruled out 
a small number of potential subjects 
from participation. The majority 
(84) of the subjects were referred 
for Vocational Evaluation by the 
Division of Vocational Rehabilitation, 
For 67 of the subjects, the primary 
source of i ncome was from thei r own 
fami 1 ies . Demogra phi cal ly , they 
were primarily Caucasian (81) males 
(53). The average age was 28, with 
a range extending from 16 to 59. 
The most frequently indicated primary 
disabil ities were as follows: Orthopedic, 
Muscul o-Skel etal , MS , MD, Stroke 
(34) ; Learning Disability, Devel opmentally 
Del ayed (18) ; and Al cohol ism (10) . 
Regardless of the primary disability, 
twenty-two percent of the cl ients 
(19) were industrially injured. 

In presenting the resul ts, reference 
will also be made to Special Education 
students. These were recruited for 
some of the studies at two sites. 
One was 916 Vo-Tec at White Bear 
Lake , Minnesota . The other was the 
W.A.T.C.H. (Work Adjustment and Training 
Center for Handicapped) program of 



108 



Cincinnati , Ohio. Both of these facilities 
serve large numbers of handicapped 
youth referred primarily by the public 
school systems. These subjects were 
also randomly selected for participation 
in one of three studies. This sample 
is ancillary to the present report , 
and full reports utilizing their data 
are forthcoming. 



Instruments 

The vocational Decision-Making 
Interview ( DMI ) is the primary instrument 
of concern in these studies, as it 
is the instrument being developed 
and val i dated . It has been summarily 
described above. Only a short description 
will be given here, and the reader 
is referred to the two previous publi- 
cations mentioned above (Czerlinsky 
et. al., 1982; Strohmer et. al , 1984). 
Basically, the DMI is a structured 
interview format comprised of eighty 
questions. It taps three general 
topic areas, which have been labeled 
Sel f-Apprai sal , Employment- Readiness, 
and Deci si on-Ma ki ng- Readiness. Each 
of these topic areas is in turn comprised 
by sub-categories directed toward 
the actual problems faced by handicapped 
individuals. The eighty items of 
the DMI are read to the client, and 
the client answers whether the item 
is true for him/her, whether the item 
i'-: false, or whether he/she is not 
sure. Being an interview, rather 
than a test, interpretation and elaboration 
by the tester (within specified limits) 
is permitted and, with certain types 
of clients, encouraged. Each of 
the items is scored on a three point 
scale (True , Not Sure , or Fal se) . 
In addition, about hal f of the items 
are f ol 1 owed by open-ended stems , 
for whi~h the client indicates actual 
choi ces cor res pondi ng to the items . 
Depending upon the particular character- 
istics of cl ients being interviewed, 
total DMI admi ni strati on takes from 
twenty minutes to f i f ty mi nutes . 
The average administration time is 
about a half-hour. 



Procedures 

At the Vocational Development 
Center, Vocational Evaluations are 
typically of a one-week duration, 
beginning on Monday and ending on 
Friday. At the beginning of each 
evaluation week, the manager of the 
eval uation services compiled a 1 ist 
of cl ients who were to receive Vocational 
Evaluation, and who could be considered 
as potential subjects. The experimenter 
then approached each potential subject 
to inquire whether he/she would be 
interested in participating in the 
study. The procedures of the study 
were fully explained to all potential 
subjects , and any questi ons whi ch 
they had were answered. Clients 
were totally free to decline to partici- 
pate. 

Subjects who agreed to participate 
were scheduled for their first interview 
on Monday or Tuesday of the week. 
At this interview, the informed consent 
form was read to them. After subjects 
signed this form, extensive demographic 
data was collected in a structured 
interview. Then the DMI was admi- 
nistered. It was read to each subject 
individually, in a testing room which 
was quiet and private . If a subject 
did not understand an item, the experi- 
menter would elaborate and explain 
the item before proceeding to the 
next item. At the completion of 
the DMI , subjects were scheduled 
for their second interview later 
in the week. Scheduling was conducted 
so that all subjects would have a 
four day pre- to post-evaluation 
i nter val (e.g., subjects i ntervi ewed 
on Monday woul d be re- i ntervi ewed 
on Thursday, whil e those i nterviewed 
on Tuesday woul d be re- i nterviewed 
on Friday). 

At the second interview, the 
post-evaluation DMI was administered, 
in the same manner as the pre-evaluation 
DMI . After completion, subjects 
returned to their evaluator to complete 
the Vocational Evaluation process . 
All subjects who completed the study 
were paid $5.00 for participation. 
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In the "Results" section below, 
reference wi 1 1 be made to some compari sons 
of means based upon students. The 
students were subjects in a different 
study, which was carried out in Special 
Education settings (mentioned previ- 
ously). These students also received 
Vocational Eva! uation at their respective 
settings, but only one DMI_ was adminis- 
tered, and this PHI corresponds to 
the pre-eval uation DMI in the VDC 
client study. 



Results 



The results are presented in 
several sections. The primary results 
for purposes of this paper concern 
the relationship between the pre-eval- 
uation DMI scores and the post eval uation 
DMI scores. Table 1 presents the 
pre-post rank-order correlations for 
the three DMI subscales as well as 
for the DMI_ total score. Rank-order 
correlations were utilized so that 
relative stability could be determined 
in a situation in which an active 
treatment intervened between the two 
measurements. As can be seen from 
this Table, there is a significant 
positive correlation for Employment 
Readiness (r=.61), for Self-Appraisal 
(r=.73) , and for Decision-Making Readiness 
(r=.71) when correlating pre with 
post scores. DMI Total score pre-eval ua- 
tion also correlated quite highly 
(r=.78) with the corresponding Total 
score at the end of evaluation. Each 
of these correlations was well past 
the .01 level of significance* These 
correlations indicate that overall, 
DMI scores at the beginning of the 
Vocational Evaluation are quite satis- 
factory predictors of DMI_ scores at 
the end of Vocational Evaluation. 
Or at least (regardless of the evaluation 
that was conducted), that DMI scores 
at one point in time are relatively 
stable at a point four days later. 
An important point to keep in mind 
is the word "relatively," since this 
will play an important part in the 



interpretation of the next set of 
data, and will be discussed later. 



Table 1 

Pre-Post Evaluation Rank-Order Correlations 
for the Vocat i onal Deci eion-Maki ng Intervi ew 



Pre-Post Corr q 



Employment Readiness J 


.61 


1 < 


01 


Self Appraisal j 


.73 


: < 


.01 


Decision Making Readiness ! 


.71 


: < 


01 


QQI Total ! 


.78 


i < 


01 



The next set of analyses was 
concerned with whether the active 
intervention of Vocational Evaluation 
appeared to have an effect on the 
cl ients i n this study, in terms of 
their scores on the subscales and 
total on the DMI_. That is, all clients 
participated in four days of Vocational 
Evaluation between the pre-test and 
the post- test. Presumably Vocational 
Evaluation addresses issues such 
as those tapped by the DMI., and thus, 
if the Eval uati on is ef fecti ve in 
such a short period of time on these 
dimensions, an effect of the Evaluation 
may be detectable by looking at differ- 
ences between the pre- Eval uation 
and the post-Evaluation DMI scores. 
The me^ns for the sample of cl ients 
on the pre and the post test are 
shown in Table 2. Again, this Table 



Pre-Post Evaluation Means 
for the Vocational Decision-Making Interview 



MEANS 

Pre Post t e 



Employment Readiness 


11 


.37 


13 


56 


J 7 


83 K 


01 


Sel 4 Apprai sal 


15 


.92 


ie 


54 


: 7 


40!< 


01 


Decision Making Readiness 


t 16 


69 


19 


85 


; e. 


94 :< 


01 


BQI Total 


43 


98 


si 


94 


in. 


09 l< 


01 



is broken down into the three DMI 
subscales as well as a total score. 
The Table shows the pre-Eval uation 
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means, the post-evaluation means, 
and the results of tests for any differ- 
ences between these means. Inspection 
of this Table shows a very clear pattern 
over the course of the Evaluation. 
Every subscale of the DMI_ (and thus 
also the total score) showed an increase 
over the four day period in which 
the clients received their Vocational 
Evaluation. The mean for Employment 
Readiness showed an increment from 
11.37 at pre-Eval uation to 13.56 after 
the process. The Self-Appraisal scores 
went from a 15.92 pre-score to 18.54 
after the Evaluation. And Decision-Making 
readiness changed from a pre-Eval uation 
mean of 16.69 to 19.85 after the Evalu- 
ation. The score of the JMI total 
score therefore increased also, going 
from 43.98 to 51.94. Table 2 also 
shows the significance of all of the 
differences between the means, utilizing 
a correlated t-test. This pattern 
of change from the beginning of Eval uation 
to the end of Evaluation is also shown 
in the histograms appended to this 
paper, labelled Fig. 1. 

The above two sets of data will, 
be fully addressed in the discussion. 
At this point, however, it should 
be made clear that two different patterns 
have been delineated in the pre- and 
post-Evaluation DM I scores. First, 
the scores remained relatively stable 
over the course of the Evaluation, 
as were indicated by the significant 
rank- order correl at ions . Secondly, 
scores changed significantly over 
the course of the Evaluation, being 
higher at the end of the Evaluation 
than at the beginning. What this 
pattern indicates is the DM I scores 
were stable in a relative sense, with 
cl ients roughly maintaining their 
relative ranking within the group 
of subjects from beginning to end 
of the Evaluation. That is, clients 
who had relatively fewer problems 
in making vocational decisions (as 
judged by the DMp at the beginning 
of evaluation still, in a relative 
sense, had fewer problems than the 
other clients at the end of the Evalu- 
ation. Imbedded within this pattern, 



however, is a significant effect 
of the active Evaluation treatment. 
Without question, the clients in 
this study scored better on the DMI 
at the end of the Evaluation tTian 
they did at the beginning. Another 
way of saying this is that the Evaluation 
appeared to have a positive effect 
on the majority of the clients. 

One last pattern of means will 
also be mentioned. As pointed out 
earl ier , DMI data, in a somewhat 
di f ferent desi gn , was al so col 1 ected 
at two Special Education sites (White 
Bear Lake, Minnesota, and Cincinnati, 
Ohio). The overall results of these 
studies are currently being analyzed. 
However, Figure 2 shows a comparison 
of DMI subscore means for both the 
Special Education and VDC client 
populations. It can be seen that 
the Special Education Students are 
somewhat 1 ower than the cl ients on 
all three of the DM scales. Note 
that the client means are based upon 
the pre-Eval uation DMP s , before 
any influence of the process of Evaluation 
would have increased the scores. 
Age and life experience may be showing 
their influence in these differences. 

Discussion 

The data that has been presented 
above represents several in a series 
of studies concerned with further 
rel iabil i ty , val idi ty , and util ity 
testi ng of the Vocational Deci sions 
Making Interview ( DMI ) . The development 
of the DMI has been carried out in 
a series of successive research projects, 
with the current projects marking 
the end of the developmental phase. 
The results that were obtained before 
the initiation of the current project 
have been descri bed at the beginning 
of this report. References have 
been given for any readers who would 
1 i ke to become more famil iar with 
the basic structure of the instrument, 
or with specifics of the prior research. 
In this earlier research, the DMI 
was devel oped , tested, and revised. 
Reliability and validity indicators 
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were promising for an initial version 
of a new instrument. 

The current series of projects 
is comprised of a number of studies 
conducted at rehabilitation and special 
education sites, and subjects are 
recruited from both vocational rehabili- 
tation and special education populations. 
The research designs of these studies 
have already been detailed. The data 
of the present report comes primarily 
from a rehabil i tat ion cl ient study 
in which clients were interviewed 
with the DTU as they began Vocational 
Evaluation and again as they completed 
the evaluation. The primary purposes 
of this design were 1) to evaluate 
the stability of DMI scores over an 
interval of time, while 2) determining 
v/hether an active treatment (Vocational 
Evaluation) would have a discernible 
effect on DMI scores. 

The results showed a number of 
clear patterns. First, the rank-order 
cor re 1 at ions between pre-eval uation 
DMI scores and post-evaluation DMI 
scores were positive and significant. 
Secondly, on all of tNe DM subscales 
as well as on total score, the post- 
evaluation means were significantly 
elevated over the pre-eval uation level. 
This was an interesting pattern of 
results. The differences between 
the pre- and post- means indicates 
that during the course of the Vocational 
Evaluation, clients significantly 
improved in their scores on the DMI . 
However, the correlations between 
pre- and post- suggest that while 
clients improved on the DMI during 
the study, their relative scores were 
fairly stable. This suggests that, 
during the evaluation, a positive 
influence appears to have been exerted 
on a 1 arge number of cl ients „ Thus , 
the best predictor of post-evaluation 
scores appears to be a combination 
of pre-eval uati on score and average 
change during the process of Vocational 
Evaluation. This is a positive statement 
both for the DMI and for the process 
of Vocational Evaluation. From looking 
at these results, one can conclude 
that 1) DMI scores exhibit relative 



(to one group) stability over a period 
of four days, and 2) the process 
of Vocational Evaluation seems to 
exert a positive influence on vocational 
decision-making capacity (as measured 
by the DMI). 

One criticism that can be directed 
agai nst a research desi gn of this 
nature is that the post- test may 
have been i nf 1 uenced by the pre- 
test, since it is the same instrument 
admi ni stered only four days apart. 
However , thi s cri ti ci sm seems rather 
unlikely, since, in the previous 
study mentioned earl ier (Czerl insky, 
et .al . , 1982) , a be tween- sub jects 
design (which used a group of vocationally 
undecided and a group Gf vocationally 
deci ded cl ients as subjects) found 
a comparable difference between the 
means . Conversely, in the previous 
between-subjects desi gn , a potential 
cri tici sm was that the vocationally 
decided cl ients (cl ients receiving 
vocational trai ni ng) may have been 
higher on the DMI simply because 
of sel ection factor that prevented 
the less vocationally decided clients 
from enter i ng vocati onal training. 
The present results, utilizing a 
with in- subjects desi gn , makes this 
second criticism also appear less 
likely. When the same pattern is 
found utilizing both a between- and 
a within- subjects design, the results 
become more convincing. An additional 
comparison is currently being conducted, 
but the data is not yet compl etely 
collected. This is a test-retest 
design with no intervention, which 
will be utilized as a comparison 
no-treatment control group. If the 
above interpretation is correct , 
then this test-retest study will 
show significant correlations between 
the two DMI admini strati ons (as the 
present results) but no significant 
difference between the two adminis- 
trations. 

The last com pari son presented 
in this report was shown on Figure 
2. This concerns the means on DMI 
scores of clients and of students. 
This figure was not a statistical 
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comparison, but rather was presented 
as a point of interest. In ggneral , 
the special education students scored 
fairly close to the means of rehabili- 
tation cl ients , but they were consistently 
somewhat lower. This may be an indication 
that the special education students, 
when compared to the rehabilitation 
clients, were somewhat less job ready 9 
or have had less life experiences. 
In general, it may be indicative simply 
of less maturity. 

The results presented in this 
report are a further step in the develop- 
ment of the PHI . When eval uati ng 
these and previous data, it is important 
to keep in mind that the instrument 
is still evolving and changing, and 
that further refinements will undoubtedly 
still take place. Several points, 
however, need to be addressed concerning 
the data presented. First, as was 
mentioned above, the present design 
(wi thi n- subjects test- re test-design) 
has certain limitations as well as 
strong points. But when combined 
with the previous between-subjects 
design, the overall results of each 
one support the other, and the data 
from both series of studies are consistent 
with each other and help rule out 
experimental artifacts. 

A second poi nt to be addressed 
concerns the nature of the treatment 
intervention in this study. The data 
has suggested that Vocational Evaluation 
has an effect on elevating scores 
on the PHI . The evaluation is an 
active treatment, and Vocational Evaluation 
is directed toward the realm that 
is measured by the PHI . But the results 
do not indicate specifically which 
aspects of Vocational Evaluation may 
be most rel ated to thi s change . Somethi ng 
within the process of Vocational Evaluation 
appears to be effective, but what 
the specific aspects are which contribute 
to this effect is open to speculation 
and to further research. As the PHI 
becomes more refined as a result of 
additional research and utilization 
within the field, it is hoped that 
such questions can be addressed and 
answered, since answers to such questions 



could be very beneficial to the fields 
of Vocational Rehabilitation and 
Special Education. 

The ultimate criterion for an 
instrument, such as the PHI , once 
its reliability and val idi ty have 
been established, is concerned with 
its utility. It must provide something 
useful to the field. It is expected 
that the PHI will impact at a number 
of different levels. 

Fi>st , it shoul d be of benefit 
to handicapped individuals themselves. 
It can provide feedback which should 
be helpful for such individuals in 
defining their own areas of strength 
and weaknesses in terms of vocational 
deci si onmaki ng. It can be util ized 
in a manner that enables such individuals 
to become more actively involved 
in the process of making their own 
vocati onal deci si ons . This shoul d 
be qui te important while they are 
receiving a service such as Vocational 
Evaluation. An important point in 
the regard is that the PHI will not 
be restricted to a very narrowly 
defined population. It should be 
useful not only for rehabil itation 
cl ients , but also for a range of 
other special handicapped populations. 
Its mode of administration (a verbally 
admi ni stered structured interview 
with allowance for clarification 
and interpretation) contri butes to 
making it useful to a variety of 
popul ations . It may be found that 
the PHI is more suitable for some 
types of persons (on a basis of disa- 
bility, age , etc.) than for others , 
but this will remain to be seen as 
the i nstrument begi ns to be util ized 
and evaluated in the field with a 
var i ety of popul ations i n a variety 
of settings . 

Secondly, the PHI shoul d be 
very hel pful to service providers 
(such as counsel ors and vocational 
evaluatorss) concerned with vocational 
decision-making of their clients 
or students. It is designed to provide 
i nf ormati on which can be used by 
these professionals in providing 
the appropriate services. It should 
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provide an efficient means of gathering 
this information, since the data can 
be collected rather quickly and effi- 
ciently, and it can be collected early 
in the treatment process, which means 
that treatments can be individualized 
right at the beginning of the treatment. 

Thirdly, the instrument can be 
used to help improve services. It 
can point out areas of vocational 
decision-making which may not effectively 
(or at all) be addressed by a treatment, 
and greater emphasis can be placed 
upon aspects which the DMI shows to 
be in need of such. In addition, 
by providing information about a person's 
vocati onal deci si on-making strengths 
and deficits out front at the beginning 
of a treatment such as Vocational 
Evaluation, the program/ service can 
be individualized and tailored to 



the specific needs of the particular 
individual it is intended to serve. 

Lastly, the DMI has the potential 
to be very useful in designing new 
programs directed toward al leviating 
vocational indeci si on. For exampl e , 
it has been used by a publ ic school 
system as one input for devel oping 
a new cur r i cul urn for hand i capped 
high school students to help them 
plan for their vocational future. 
The DMI_ dat'a provi ded i ndi cat or s , 
i n tM" s case , whi ch were used for 
determining the areas which the new 
curriculum is addressing. 

All in al 1 , as the above indicates , 
the DMI should have a broad spectrum 
of util ity , ranging from the handicapped 
individual, on the one hand, to the 
devel opment of new programs , on the 
other hand. 
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Figures 1 & 2 
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FIG2: STUDENTS/CLIENTS ON DMI 
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APPENDIX B 



Sample DM I Items 



DMI Employment Readiness Scale ~ Sample Items 

I have few job choices, because it 
is hard for me to get around. 
I would take a job that my family 
and/or friends didn't approve of. 



DMI Self Appraisal Scale Sample I tens 

I feel sure of myself when I have 
to njake a decision about a job. 

I have let others decide which job 
was best for me. 



DMI Decision Making Readiness Scale — 
Sample Items 

I would be good at choosing a job 
on my own. 

If I know what a job is like, I can 
decide if I could do the work. 
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A COMPARATIVE STUDY OF PERFORMANCE 
SCORES ON THE VALPAR COMPONENT WORK 
SAMPLES 



PIERRE OION 



ABSTRACT: This study focused on an 
analysis of performance scores on 
the Va'ipar Component Work Samples 
(VCWS) numbers 1, 4, 5, 6, 8, 9 and 
11 of local handicapped individuals 
compared with normative data obtained 
from Valpar using their standards 
of two populations, the Skill Center 
and San Diego Employed Worker norms. 
Results identified a general trend 
in which the vocationally handicapped 
indi vidua 1 s performed significantly 
slower on time parameters and where 
applicable, accuracy measurement than 
the competitive group norms. These 
results have relevance to the^moti vation, 
aspirations and degree of disability 
limitations of clients to enter those 
skill occupations as assessed by the 
VCWS. 



Com pet i ti ve work sampl e norms 
offer the opportunity to describe 
the level of performance attained 
by vocationally handicapped individuals. 
As a reference group, competitive 
norms introduce a measure of employabil ity 
used as a basis for comparing clients 
and competitive norm groups, comparing 
a client's level of performance with 
i nd us trial and/or traini ng school 
n^rms has elected a controversial 
debate (Allan & Sax, 1972; Gibertson, 
1973; Hansen & Menz, 1979; McCray, 
1979, 1980; Parker & Hansen, 1976). 
Berven & Maki (1982) indicated that: 

Use of cl ient norms may overestimate 
ootential for competitive employment, 
where the performance of the 
client is well below that of 
employed workers .... On the 
other hand , use of industrial 
norms may underestimate potential 
due to client inexperience as 
an industrial worker, or to 
disabil ity and associated functional 
limitations, or both. (p. 22). 

Thus, client norms are potentially 
more lenient toward sati sfactory 
performance requirements. Consequently, 
competitive norms with restrict satis- 
factoriness of performance for even 
those cl ients that performed wel 1 
when compared to other clients. 

The concern that competitive 
norms could be prejudicial to clients 
was also discussed in a Research 
and Training Center conference on 
critical issues in vocational evaluation 
(Dunn, Korn, & Andrew, 1976) where 
attention was drawn to the fact that 
the full percentile range of industrial 
norms are considered acceptable to 
the labor market. Thus, even the 
first percentile of these norms are 
deemed sati sfactory . Eventual ly, 
the debate of using clients vs. corn- 
pet i ti ve norms was resol ved by the 
adoption of a work sample standard 
developed by the Vocational Evaluation 
and Work Adjustment Association (VEWAA) 
and the Commission on Accreditation 
of Rehabilitation Facilities (CARF) 
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which declared that "Competitive norms 
or industrial standards shall be esta- 
blished and used 1 ' (CARF, 1978, p. 28). 

Alternatively, maintaining and 
updating client norms can be used 
to assess strengths and weaknesses 
of the popul ation served. For descriptive 
purposes, comparing sets of norms 
from subgroups of clients enables 
practitioners to clarify functional 
characteristics related to the popu- 
lation's demographic variables. In 
addition, such norms provide baseline 
data for measuring the extent to which 
client norms differ from competitive 
norms. If it is expected that client 
norms overestimate potential for competi- 
tive employment, then measuring this 
o verestimation would have relevant 
impact to program evaluation. 

The ourpose of this .study was 
to compare the performance of vocationally 
handicapped individuals on selected 
Valpar Component Work Sample with 
normative data obtained from the Valpar 
manufacturers on the San Diego Employed 
Worker Group and the Skill Center 
Low Income unemployed group. The 
intention of the comparison was to 
verify and examine the assumption 
that client norms ere different than 
competitive norms. 



Method 



Subjects 

Baseline data were obtained from 
400 disabled clients undertaking a 
vocational assessment program at the 
Resource Development Center (RDC) 
in Calgary, Alberta, Canada. Depending 
on the Valpar Component Work Sample 
(VCWS) administered sample size ranged 
from 38 to 397 clients with varying 
proportions between demographic variables. 

The majority of clients were 
of Caucasian descent (approximately 
90%) with mean age of 26.7, education 
level of 10 years and men/women ratio 
of 2:1. Clients 1 disabilities were 
grouped into four categories. In 



category one, clients were diagnosed 
as emotional ly/psyc hi at rical ly disabled. 
A second category comprised those 
clients experiencing some type of 
learning disability in school systems. 
A third category included those clients 
medically diagnosed as having a physical 
dysfunction. A fourth category (mis- 
cellaneous) was given to those clients 
who did not easily fit the above 
di sabil i ty groupi ng but experienced 
di f ficul ties procuring or staying 
with employment. 



Table I 

RDC rop U l_gcjj)n Description for Each of the Valpar Work Sjnyplos 

Pc-entnt;^ (X) 

Sample Me;in Sex Dlsabi 1 1 ty ** 



Vt'WK * Slae Aftf Men Wnmc.11 ISO l.h Pll NS 

I- Sm;iU Tools 23 23.3 94. 7 5 . 3 34.2 31.6 2.6 31.6 

346 25. 7 76. 1 "» ..9 39. 3 24.3 12.4 2*.0 

5- CCA 

Tel. 64 27.4 3fl.9 61.1 43.7 17.2 U.l 25.0 

MS 65 27.3 33.8 66.2 43.1 18.5 13.8 24.6 

FH 62 27.6 30.6 69.4 45.2 19.4 12.8 22.6 

UK 55 28.6 37.0 63.0 40.7 20.4 11.1 27.8 

typ 35 27.2 14.3 85.7 48.6 20.0 14.3 17.1 

6- Prohiem 

Solving 131 24.6 57.8 42,2 32.8 32,1 10.7 24,4 
fl-Simm fl ted 

Asso m bly 238 25.9 67.2 32.8 36.2 30.7 11.3 21-8 

9-WHRH 361 26.1 65.4 34.6 39.6 28,5 10.0 21-9 

I I- EHPc 397 26.1 65. 7 34.3 40.6 25,2 11,0 2 3.2 

Hotel *VCWS UERM - Upper Extremity Range of Motion; CCA - Clerical 



Comprehension and Aptitude (Tel - Telephone Answering; 
MS - Mall Sorting; Fll - Filing Lctti> r ** UK - Bookkeep 
Typ - Typing); WBRM - Whole Body Range of Motion*, 
EHFC - F.yo/Hand/Foot Coordination. 
**tMsnbHlty ED - Emotional; LD - Learning: PH - Physical; 

NS - Nmi-Speclflc 

Agency f il es reported that 21% 
of the 400 clients were known to 
have obtai ned gainful em pi oyment 
upon completion of the program. 
The demographic profile of these 
subsequently employed clients resembled 
the total sample population. 
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Instrumentation 

The Valpar Component Work Samples 
were admi ni stered f ol 1 owi ng the directions 
and procedures outlined in the Valpar 
Manual . 

Seven components of the Valpar 
Work samples were used in this study 
and admi ni stered to sel ected 
of clients based on their 
and aptitudes. 



groups 
interests 



VCWS #1 
Performance 
accura cy. 



• Small tools (mechanical), 
is scored on speed and 



Diego Employed Worker Group), 8, 
and the total points scores of the 
Skill Center group for work sample 
#11. On these aforementioned work 
samples, cl ients performanced signif- 
icantly slower and/or less accurately 
than the competitive groups. 

Subsequent analysis of performance 
between subgroups within the RDC 
client population delineated by age, 
sex, education, type of disability 
and employment status revealed significant 
di f ferences between men-women performance 



VCWS #4 - Upper Extremity Range 
of Motions. Performance is scored 
on speed. 

VCWS #5 - Clerical Comprehension 
and Aptitudes. Performance is scored 
on speed and accuracy. 

VCFS #6 - Independent Problem 
Solving. Performance is scored on 
speed and accuracy. 

VCWS #8 - Simulated Assembly. 
Performance is scored on the number 
of assembl ies compl eted duri ng the 
time interval . 

VCWS #9 - Whole Body Range of 
Motions . Performance ■ is scored on 
speed. 

VCWS #11 - Eye Hand Foot Coordi- 
nation. Performance is scored on 
speed and accuracy. 



Results 



T-test analysis indicated significant 
differences in the comparison of mean 
time and accuracy scores between the 
RDC clients and the San Diego Employed 
Worker and the Skill Center low income 
group on most of the Valpar Components. 

Specifical ly , significant differences 
were obtained on the VCWS #1, 4, 5 
(except for typing erronrj, 6 (excluding 
time scores compared with the San 



To.le 2 

Mean Scores and Co mpnrlsons Between RDC Clients nnd Vnlnnr Norn 
Croups for Selected VCWS 



RDC 
Clients 



San Olego 
Employed Workers 



Sk< 11 Cent re 
Low Income 



Hcan(n) T-Valuc Mcan< a) T-Valuc 



6232.42 
2645.17 
5.92 



614.07 
724.86 

850. as 



361.51 
397.87 
494.29 



9.42 * 
11.56 * 
18.76 * 



3799.34 
1518.24 
.82 



344.68 
399.26 
449.26 



5.06 * 
5.04 * 
2.21 * 



10.24 * 
10.44 * 
18.93 * 



VCWS 

'1 Small Tools 
Time 
Assembly 
Disassembly 
Errors 

14 Upper Extremity 
Range of Motions 

Time 

Dominant Hand 
Other 

Disassembly 
N.itc: * • p < .05 

**-• Not Avsllnble 

(.■>) - Source: Valpar (l97'«). Kv aluators' Handbook . Arizona: Val pnr 

15 Clerical 
Comprehension 

Telephone 
Answering 

Mall Sorting 

- Time 

- Errors 
FillnR Letters 

- Time 

- Errors 
Bookkeeping 

- Time 

- Etotr 
Typing Words 

- Errors 



1251.03 
7.06 

1623.10 
6.47 

2806.67 
11.15 
121.36 
13.74 



50.92 

680. 12 
2.32 

1066.59 
3.10 

1969.44 
8.48 
146.60 
10.98 



2.85 * 

4.97 * 
4.90 * 

4.82 * 
2.42 * 

4.21 * 
1.90 * 
3.25 * 
1.01 



Note: * • P < .05 

- Not Available 

(«) - Source: Valpar (1974). Evslustors' Handbook . Arizona: Valpar 
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Table 2 - Cont'd. 

Mem Scores and Comparisons Between RDC Clicucs .tud V.ilp.ir Norm 
Croups for Selected VCWS 



RDC S.in Diego 

Clients Employed Workers 



He, in He. in 



Skill Centre 
Low Income 



VCWS 

16 Problem Solving 

Time 1212.56 IOB9.23 

Errors 4.11 .Bl 

IB Si ran l.i ted 
Assembly 



1 .54 
5.BB 



795.00 
2.35 



4.76 
2.50 ' 



197.33 



#9 Whole Body 

Range of Motions 



#11 Eyc-Hand-Foot 
Coord inat ion 

Totnl Points 

Time 



1670.80 1326.53 



137.90 156,00 
532.90 565.15 



1.49 
0. 7B 



162.59 
576.45 



1.85 
1.33 



Note: * • p < .05 

- ** • Not Av.iil.ible 
(a) • Source: V.ilpn r (l?74). Evalun tors ' H.indbuok . Arizon.i: Valp.ir 

on Val par Component #4, 9, and 11 
where men performed faster than women. 
Physically disabled clients performed 
slower on Valpar Component #8, 9, 
and 11 when compared with the emotional 
and learning disability groups. No 
other consistent significant differ- 
ences were noted between pair wise 
comparison of subgroups based on age, 
education, empl oyment status and disability 
groupings. However, the subsequently 
employed clients of the RDC population 
evinced lower time and quality scores 
when compared with the San Diego Employed 
Worker norms. 

Discussion 

The description of norm groups 
provi ded by Val par offers 1 i mi ted 
demographic information to establish 
si mi 1 ar i ties and differences between 
characteristics of those groups and 
the RDC population. Valpar gives 
no descriptive statistical data pertaining 
to age, sex and education distributions. 
The bul k of the information focuses 
on the qualitative traits of the groups. 

The San Diego Empl oyed workers 
are rel ated to sel ected worker traits 
arrangements which emphasize an employment 
value to the assessment of competitive 



performance . Even i f quanti tati ve 
al 1 oca t ion of workers by trait are 
omi tted , the occupati on 1 is ting of 
the Empl oyed Worker Group i ncl udes : sor- 
ter , mac hi ne operator , assembl er , 
fork lift operator, duplication clerk, 
cashi er , bagger , ri gger , cabl eman , 
warehouseman , el ectronic assembl er , 
and secretary (Eval uator' s Handbook, 
1974). These workers held their 
occupations with satisfactory performance 
for a minimum of six months. 

The Skill Center group comprised 
unemployed, low income, non-handicapped 
individuals entering a vocational 
training program with emphasis placed 
on mechanical areas. 

The two major distinctions which 
appear to be responsible for performance 
di f ferences between the cl ient group 
and the competitive groups are: 
first, the employee and trainee status 
of the competitive groups i n regards 
to the rehabilitant status of clients. 
Second, the competitive groups are 
no n- handicapped where most cl ients 
are grouped in either the emotional, 
1 earning or physical disabil ity classifi- 
cation. 

When considering Val par 1 s focus 
on physical abil i ty and coordination 
for work sample number 1, 4, 8 and 
9, factors such as motivation, concen- 
tration, tolerance and manual proficiency 
determine performance efficacy. 
The 1 abor market or traini ng school 
settings enable the development of 
steadiness, precision, ability and 
st ami na for those range of motions 
of the upper torso and whol e body. 
Thus the competitive group 1 s famil iarity 
with such physical activities augments 
stri ngency of performance standards 
(McCray, 1979, 1980). Although RDC 
clients were instructed to work as 
fast and accurately as they could, 
the com pet i ti ve groups proved more 
adept. RDC cl ients were bel ieved 
to be less accustomed to the physical 
demands assessed by the aforementioned 
VCWS and , consequentl y experienced 
slower execution of physical motions. 
In the case of physically disabled 
clients, limitations of body mechanics 
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impede the ability to meet the rigors 
of these manual tasks. The much slower 
performance evinced by women clients 
appears to be attributed to the irfluence 
of sex stereotyping favoring men in 
manually oriented tasks. 

Valpar work sample number 5 and 
6 emphasize attention, retention of 
instructions, productivity and cognitive 
abilities for accurate process i ng 
of clerical details. On such work 
samples, clients required more time 
and performed less accurately than 
the competitive groups. In general, 
the RDC clients have not been previously 
exposed to such skill requirements 
in a work or training environment, 
thus mitigating their abilities to 
assimilate the rudiments of vocational 
performance. 

The inferior level of performance 
of clients stems mainly from inexperi- 
ence. However, their vocational handicaps 
incur problems related to work performance, 
not only limited to aptitudes and 
abilities but extending to personality, 
attitudes , educabil ity, trainabil ity 
and empl oyabil ity which prevent them 
from functioning adequately in work 
settings (Pruitt, 1977). Because 
of such limitations, they can also 
be bereft of vocational goals and 
motivation. 
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VALPAR COMPONENT WORK SAMPLES: 
A CORRELATION ANALYSIS 



PIERRE DION 



ABSTRACT: This study focused on the 
inter-correlations of the Val par Component 
Work Sample (VCWS) number 1, 4, 5, 
6 , 8 , 9 , and 11, High correl at ions 
were expected between the work samples 
having similar requirements of physical 
activities and/or relating to common 
worker trait groups. A Pearson Product 
- Moment correlation analysis was 
applied using data obtained from vo- 
cationally handi capped i ndi vi dual s 
undertaking vocational assessment . 
Although commonalities exist between 
selected VCWS, tasks specificity of 
each VCWS produced findings of medium 
to low correlations . 



The Labor Market encompasses 
a variety of occupational groups, 
each compri si ng composi te prof il es 
of required vocational skills. For 
the vocational evaluator, these profiles 
represent the bas i s for conducting 
vocational assessment. Because qual i- 
ficat^on factors differ between and 
within groups of occupations, the 
evaluator must determine the appropri- 
ateness of using assessment instruments 
that measure abi 1 i ties rel ated to 
a particular occupation or applicable 
to groups of occupations. Among 
the various tool s used in vocational 
evaluation, work sample systems have 
been designed to accommodate a single 
or cluster trait approach to assessment. 

The Val par Component Work Samples 
(VCWS) are i ntended to measure fundamental 
abi 1 i ties recurrent in several groups 
of occupations . Devel opers of the 
Val par Component series state that 
these work samples assess "those 
worker characteristics whichare 
found to be basic indicators of success 
in numerous job famil ies" (Brandon, 
Button, Rastatter & Ross, 1974, p. 1). 

But the VCWS have largely been 
regarded as no n- interdependent assessment 
tools. Botterbush's (1980) review 
of commerci al vocational eval uation 
systems emphasi zed the fact that 
11 Val par is a group of inde pendent 
work samples and not a system" (p. 75). 
Consequently, Botterbush (1980) questioned 
the work samples' relatedness to 
occupational groups . 

Although Brandon, et al . (1974) 
recommended that the VCWS be incorporated 
with work sample systems extant , 
Val par-Specti ve (1979) identified 
essential components which, when 
combined, consolidate vocational 
i nf or ma t i on . Thus , the VCWS can 
potentially be integrated to form 
a system of vocational evaluation. 

Such integration can be shown 
from the commonalities that exist 
for the VCWS numbers 1 , 4, 5, 6, 
8, 9, and 11. Excepting work sample 
5, Clerical Comprehension and Aptitudes, 
which incorporates several related 
and often concurrent office duties , 



110 



the majority of the VCWS measure skills 
such as manual dexterity and motor 
coordination. In some cases, several 
work samples evaluate abilities related 
to common worker trait groups. 

The purpose of this study was 
to analyze the i nter-correl ati ons 
of the a foremen ti oned VCWS. It was 
expected that work samples sharing 
common factors and worker trait groups 
would produce consistent high corre- 
lations. 



Method 



Subjects 

Data were obtained from 400 disabled 
individuals undertaking a vocational 
assessment at the Resource Development 
Center, Calgary, Alberta, Canada. 
Depending on the VCWS administered 
sample sizes ranged from 38 to 397 
cl ients. 

Demographic variables showed 
the following client characteristics: 
90% of the client, were of Caucasian 
descent with a mean age of 26.7 years, 
a men /women ratio of approximately 
2:1 and a reported education level 
of 10 years. 

Client disabilities were grouped 
into four categories. In category 
one, clients were diagnosed as emo- 
tional 1 y/ psych i atri cal 1 y di sabl ed . 
A second category comprised those 
clients ex peri enci ng some type of 
learning disability in school systems. 
A third category constituted those 
clients medically diagnosed as having 
physical dysfunctions. A fourth category 
(miscellany) was given to clients 
who did not easily fit the above disability 
groupi ng but were deemed handicapped 
by nature of having inordinate difficulties 
procuring or staying with employment. 
In order, the proportions of clients 
by disability categories were 40%, 
25%, 12% and 23% for the emotional, 
learning, physical and miscellany 
groups. 
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Instrumentation 

Seven Valpar Component Work 
Samples were used in this study. 
The work sampl es were administered 
following the directions and procedures 
outlined in the Valpar Manuals. 

VCWS 1 - Small Tools (mechanical). 
Performance is scored on speed and 
accuracy. 

VCWS 4 - Upper Extremity Range 
of Hot i ons. Performance is scored 
on speed. 

VCWS 5 - Clerical Comprehension 
and Aptitudes. .Performance is scored 
on speed and accuracy. 

VCWS 6 - Independent Problem 
Sol vi ng . Performance i s scored on 
speed and accuracy. 

VCWS 8 - Simulated Assembly. 
Performance i s scored on the number 
of assembl ies completed within a 
time interval of 20 minutes. 

VCWS 9 - Whole Body Range of 
Moti ons . Performance i s scored on 
speed. 

VCWS 11 - Eye-Hand-Foot Coordi- 
nation. Performance is scored on 
speed and accuracy. 



Results 

The Pearson Product - Moment 
correlation analysis indicated findings 
of medium to low correlations between 
the VCWS (see Table 1). 

Highest correlation was obtained 
between time scores of the VCWS 4 
Upper Extremity Range of Motions. 
This work sample correlated moderately 
with the VCWS 1, 8, and 9. Other 
medium correlations were noted between 
VCWS 8 and 9 and VCWS 11 time and 
points scores. 

The Simul ated Assembly and the 
Eye-Hand- Foot Coordination correl ated 
Negatively with all other VCWS having 
time measurements. 

The VCWS 6 Problem Solving and 
11 Eye-Hand-Foot Coordination correlated 
weakly with all other VCWS. 

Tabl e 2 denotes common occupational 
groups related to VCWS. 
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Table I 

Correlation Coefficients Between Selected VCWS 



vews ** 
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Note: * - 


- Not 
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p > .05 













VCWS: STTT - Small tools assembly time; BET - Time for both 
hands; DOM - Time for dominant hand; OH T - Time for 
other hand; DIS - Disassembly time; PRST - Problem 
solving time; SAP - Assembly points; WBT - Whole body 
total time; EHFT - Eye-hand-foot total time; EHFP - 
Eye-hand-foot total points; TEL - Telephone messages; 
MAST - Mail sorting time; FILT - Filing letters time; 
BKT - Bookkeeping time; TYPW - Typing words. 

Table 2 

Common Occupations Related to Selected VCWK * 

i). r. T. 

VCWK 04 and 06 

- Inspecting and Stock Checking .382, .184, .387 , .484, .487 
VCWS 04 and 06 

- Sorting, Inspecting, Mcnnurlng .484, .485, .487, .584, ,585 
and rclntcd work .587, .683, .684, .685, .G87 

VCWS 05 and 16 

- Shipping Clerk I .138 

- Office Helper .878 

- Parcel Tout Clerk .388 

- Hall Clerk .566 

- Credit Reporter .368 

- Counter Clerk .368 
VCWS 18 and 09 

- Driving - Operating .883 
VCWS 16 ond 111 

- Laundry Laboring .887 

- Inject lng-Holdlng-Hnchlne Operator .782 

- Convcyor-Llnc Operator, Automatic .782 

- Contlnuoun-Tovrl Roller (Launder lng) .885 

- Injectlng-Moldlng-Mnchlne Tender .885 
VCWS 16, 99 and 011 

- Manipulating .884 
Note: * Source: Brandon ct at. (1974) 
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From the arrangement of work 
samples reported in Table 2, correlation 
remained strongest between VCWS 4 
and 8 and VCWS 8 and 9. 

Discussion 

The VCWS small tools, upper 
extremity range of motions, simulated 
assembly and whole body range of 
motions share the importance of accurate 
eye/hand coordination, precise manual 
dexterity, awareness of spatial relation- 
ships, tactile judgement, and prolonged 
physical stamina. Al though cormionali ties 
exist among these work samples, task 
speci f ici ty between each component 
differ considerably. The VCWS upper 
extremity range of motions examines 
proficiency of dominant vs other 
hand. The VCWS simulated assembly 
requires visual tracking. The various 
postures assumed by a client on the 
VCWS whole body range of mot ions 
extend the phys i cal re qui rements 
to abil ity and bal a nee of motions. 
By itself, the VCWS 11 eye-hand- foot 
coordination measures simul taneous 
coordinated reactions. 

The low correlation obtained 
between the VCWS 6 problem solving 
and the other VCWS refers to notable 
differences of material formats , 
perceptual and learning processes 
which define the uniqueness of the 
task. 

I ntri ns i c factors such as task 
procedures , i nteraction of skills, 
focus of productivity (speed vs accuracy) 
and work behaviors pertaining to 
each work sample denote particular 
arrangement of performance requiremants. 
The arrangement of factors clarify 
the distinctions between the VCWS. 
Thus , some VCWS suppl ement the vocational 
information gathered from other VCWS 
in the assessment of qual if i cation 
factors for related occupations. 

Still, the findings of medium 
to low correlations signify variations 
of clients' performance on those 
VCWS. Such variations imply that 
client performances on those VCWS 
relating to common worker trait groups 
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are to a certain extent, inconsistent. 
Consequently, addi ti onal assessment 
covering the occupational groups 1 
composite skills would be required 
to ascertain a client's qualifications 
for such type of employment. 
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A PSYCHOVOCATIONAL EVALUATION MODEL: 
A NEW PERSPECTIVE FOR TESTING HANDICAPPED 
STUDENTS 



KATHLEEN A. GRUENHAGEN 
LAURA L. MOHR 



ABSTRACT: As the ultimate goal of 
special education is to provide handi- 
capped students with skills for life 
successes (not simply to bring them 
to their optimum achievement levels 
academically), secondary students 
must be assessed appropriatedly in 
career/vocational areas. This paper 
presents a model of psychological 
re-eval uation with career/ vocational 
components that can be systematically 
used in IEP planning. 



The ultimate goal of special 
education is to bring students to 
a level of independence with skills 
for empl oya bi 1 i ty and successful 
life adjustment, as compared to simply 
bringing them to a certain grade 
level of academic achievement. Supporting 
statistics , however, from the Second 
Annual Report of the Congress on 
the Implementation of PL 94-142 indicate 
that only 6% of all Individual Educati onal 
Programs (IEPs) for 1979-80 contained 
information on vocational goals for 
students in the 13-15 age group and 
for the 16-21 age group 31% had vocational 
goal s (Popl in, 1981) . Will (1984) 
states that the future of youth with 
disabilities is uncertain as they 
leave publ ic school and that between 
50% and 80% of disabled adults currently 
are jobless. "Qualification for 
employment, is an implied promise 
of Ameri can education. . (Will , 
1984, p. 1); thus, the Office of Special 
Education and Rehabil itati ve Services 
has established a new priority to 
improve the transition from school 
to the working life for handicapped 
individuals. 

A variety of sources in the 
literature reflects this lack of 
commitment toward teaching handicapped 
students empl oya bi 1 ity skills. Poplin 
(1981) relates that over one million 
disabled students lack career and 
vocational skills to compete for 
jobs in their communities. Batsche 
(1981) speaks of the three-fifths 
of the handi capped popul at ions who 
are not employed during a typical 
year . As a graphic il 1 ustration 
of the cost of such unempl oyed dependency, 
Batsche (1981) compares the $45 to 
$200 per day institutional settings 
cost to the lesser cost for educating 
a student at Harvard University. 

Some handicapped students , however, 
do achieve vocational education placement, 
but the validity of such vocational 
placement is open to question, since 
these pi acements rarel y are based 
on adequate assessment information. 
Vocational teachers report that tney 
are seldom asked to participate in 
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the development of the IEP or to even 
have an opportunity to review the 
IEP for handicapped students they 
teach (Batsche, 1981). 

School psychologists, as a rule, 
are not helping to provvie such secondary 
level vocational assessments. Instead, 
the main emphasis of school psychologists 
continues to be ability vs. achievement 
level orientation, particularly at 
the elementary level. An involvement 
at the secondary level has usually 
been confined to retesting for special 
education and the referral of students 
exhi bi ti ng severe be ha vi or probl ems 
(Hohenshil , 1981). Recently, a major 
thrust of the leadership of the National 
Association of School Psychologists 
(NASP), nevertheless, has been the 
recognition of vocational psychology 
as its first speciality in the profession 
(Fagan, 1981). 

In the past some school psychologists 
have been involved in the administration 
of vocational assessment batteries 
to varying degrees. Alcorn and Nicholson 
(1975) report of their experiences 
in group administration of vocational 
batteries for the mentally retarded 
and low literate under the leadership 
of the psychol ogist assisted by eval uation 
aides. The areas assessed with this 
battery included verbal and performance 
scale of intelligence, academic achieve- 
ment, mechanical aptitude, visual-motor 
perception, routine clerical aptitude, 
fine finger and gross arm dexterity, 
vocational interest areas , and personality 
assessment. Although the above battery 
was designed to be a vocational assess- 
ment, with minor additions or adjustments 
in most states these tests would meet 
the legal requirements for a scheduled 
reeval uation for secondary students. 

The conti nui ng probl em appears 
to be a lack of commitment on the 
part of school systems toward consciously 
implementing the goal of educating 
handicapped students to provide them 
with life skills for employabil ity , 
independence, and successful life 
adjustment . Secondary (junior- senior 
high) students first need to be assessed 
to determine their strengths and weak- 



nesses , and current 1 evel s of functioning 
in career/vocational goal areas as 
well as in academic areas. Since 
the IEP regulations in PL 94-142 
specify that goals and objective 
are to buil t upon the present level s 
of performance ( Federal Regi ster , 
August 23, 1977) appropriate evaluation 
adding a vocational component to 
this reevaluation for all thirteen 
to fifteen year old would enable 
career/ vocational e ducat ion goals 
to be wri tten i nto IEPs before entry 
into high school programs. 

If the ultimate goal of special 
education is to not only bring handicapped 
students up to their optimum achievement 
levels academically, but to provide 
them with skills for life successes, 
then secondary students need to be 
assessed appropriately in the career/- 
vocational areas. If the psychological 
reeval uation were to have career/- 
vocational components , these assessments 
could then be systematically used 
in pi anni ng for necessary career/- 
vocational components in a handicapped 
student's IEP. Such a composite 
eval uation for secondary handicapped 
students offers the school psychologist, 
for the most part, a different perspective 
to the traditional reevaluation. 
In a sense , the school psychol ogi st 
is not simply testing for a current 
level of functioning and diagnosis , 
but is looking toward a future prognosis. 

The Proposed Model 

Reeval uation of each teenage d 
ha ndi capped student is recommended 
to include areas of: (1) intelligence; 
(2) achievement; (3) social -emotional 
behavior; (4) interests; and (5) 
aptitude. The Psychovocational Model, 
using a multi-disci pi inary team approach, 
may include a variety of person within 
the student's ecological system: 
regular and special education teachers, 
guidance personnel and social workers, 
vocational education teachers and 
vocational rehabil itation counselors , 
school psychologists, paraprofessionals, 
and others in the school and community 
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setting who may be able to provide 
input into such a composite, ecological 
evaluation. Additionally, the tole 
of parental involvement and self-eval- 
uation procedures utilized with the 
student play an integral part in the 
overal 1 psycho vocational eval uation. 
According to Mutter & McClung (1981), 
more than simply determining vocational 
potential is involved in making a 
prognosi s . Since many empl oyees are 
not able to keep jobs because of poor 
interpersonal relationships, the area 
of future work habits/adjustment needs 
to also be included in the composite 
evaluation by obtaining observational 
data of students trying out real jobs 
either "on site' 1 or in work samples. 
Thus, the psychovocational evaluation 
needs to predict the skill potential 
as well as the social and attitudinal 
adjustments needed for successful 
future work. 



Intelligence 



An individually administered 
intelligence test is given to students 
by a qualified psychologist. Among 
the assumptions underlying test sel ection 
are comparable acculturation and adequate 
behavior sampling (Salvia & Ysseldyke, 
1981). The more commonly accepted 
tests in school settings for secondary 
students are the Wechsler intelligence 
seal es , WISC-R or WAIS-R and the Stanford— 
Bi net Intel 1 i gence Scale . The appropriate 
Wechsler scale is generally used because 
the devices are technically adequate 
and allow the examiner to look at 
more than global verbal, performance, 
and/or full-scale scores. The WISC-R 
and WAIS-R provide information related 
to individual performance on the subtests 
of the instruments (Salvia & Ysseldyke, 
1981). For those students whose level 
of functioning falls below the lower 
range of the Wechsler scales, the 
Stanford-Binet is general ly the instrument 
of choice. However, the standardization 
procedures of the 1972 Stanford-Binet 
cause the examiner to interpret the 



results with caution (Salvia & Ysseldyke, 

1981) . 

The IQ score, in and of itself, 
has 1 imi ted useful ness in vocational 
planning since the relationship between 
i ntel 1 i gence and vocational success 
remains unproved (Kolstoe, 1961; 
El kin, 1968; Song & Song, 1969). 
The Wechsler scales subtest scores 
and an item analysis of behavior 
samples on the Stanford-Binet can 
be very useful in indicating specific 
strengths and weaknesses that could 
be used for vocational pi anning (Brol in, 

1982) . according to Salvia & Ysseldyke 
(1981), intelligence tests sample 
behaviors and no one test samples 
all of the possi ble behaviors of 
intelligence. However, behaviors 
sampl ed by i ntel 1 i gence tests such 
as the Wechsler scales or the Stanford- 
Binet may include: (1) discrimination 
skills: generalization skills; (3) 
perceptual-motor skills; (4) general 
information; (5) vocabulary; (6) 
induction and rearoning; (7) compre- 
hension; (8) sequencing; (9) detail 
recognition; (10) analogies; (11) 
abstract reasoning; (12) memory; 
(13) pattern completion; and (14) 
attention. A correlation of these 
sampled behaviors from the intelligence 
tests with addition tests that measure 
precept ual -motor functioning, such 
as the Bender Visual Motor Gestalt 
Tes t or the Visual Motor Integration 
test, and with those that measure 
language abilities, such as the Test 
of Adolescent Language , or the Detroit 
Tests of Learning Aptitude (Revised, 
1984) that helps identify intraindividual 
strengths and weaknesses and specific 
apti tudes can be useful i n supplyi ng 
vocational-oriented i nf ormati on . 
Generally, such traditional evaluation 
procedures used by school psychologists 
can be modified to elicit data relevant 
to career/vocational pi anning. Thus , 
according to Levinson & Shepard (1982) 
the school psychol ogi st does not 
need to "turn enti rely to alternate 
strategies in collecting and reporting 
information pertinent to. . .occupational 
development." (p. 69) 
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Achievement 

Relative to academic achievement and 
performance levels, both norm-referenced 
and cr i ter i onref erenced tests and 
teacher evaluations of classroom perfor- 
mance would be useful vocational planning 
information. For global skill information, 
tests such as the Wide Range Achievement 
Test WRAT) or the Peabody Individual 
Achievement Test (PI AT) are often 
used to estimate the student's current 
level of functioning. For more specific 
information in pinpointing a student's 
strengths and weaknesses in academic- 
related areas, a diagnostic achievement 
shoul d be util ized. A test with adequate 
behavior samples can assist in analyzing 
the student's performance on essential 
skills that will enable them to function 
with the greatest degree of independence 
as a citizen and worker in society. 
One example of such a test is The 
Brigance Diagnostic Inventory of Essential 
Skills . Tn addi ti on t^ diagnosti c 
material on basic skills, several 
inventories of vocational relevance 
are also included such as self-concept 
rating scale, attitude rating scale, 
job interview rating scale, and communi- 
cation skills rating scale. The scales 
can be used by observers rating the 
student or by the student as self- 
reporting scales. A career-oriented 
approach to academic achievement is 
found in the Life Centered Career 
Education: A Competency Based Approach 
(Brolin, 1983). These materials infuse 
specific competencies for life skills 
with academic skills and includes 
as sessment and I E P planning forms. 
Personnel involved in assessing academic 
achievement may include, not only 
the school psychologist, but teachers 
and other educational specialists, 
incl uding wel 1-trained paraprofessionals. 

Social -Emotional Behavior 

Soc i a 1 emot i o nal assessment i s 
a particular significant component 
of the overall psychovocational evalu- 
ation. The observations , eval uation, 
and sel feval uation of social competence/- 



skills and emotional behaviors, feelings, 
and attitudes will give insight and 
information to the vocational planning 
for handicapped students . No singl e 
evaluation method can provide the 
necessary i nf or mat ion related to 
social skills. Among those procedures 
generally acceptable for gleaning 
adequate information are: 91) checklists 
and questionnaires, interviews, and 
rating data • from parents, peers and 
teachers; (2) sel f-report checkl ists 
and inventories , and (3) direct behavioral 
observations. Accord ing to Houff 
(1982), a "combination of methods 
are required to establ ish. . . particul ar 
social skills. ..and assess how the 
social environment interacts to produce 
an individual 1 s 1 evel of occupational 
social competence . " (p. 66) Among 
test used for assessing adaptive 
behavior are the AAMD Adaptive Behavior 
Scale-Revised or the Vineland Social 
Maturity Seal e-Revised and for assessing 
maladaptive behavior are rating scales 
such as the Burks 1 Behavior rating 
Scales or the Behavior Rating Profile . 

For a more detailed measure 
of those items necessary for independence 
and successful life adjustment, the 
use of Social and Prevocational Infor- 
mation Battery l s recommended wi th 
EMR students and Form T of this tool 
for moderately retarded persons (Hal pern, 
et al, 1982). Additionally, the 
Career Adaptive Behavior Inventory 
(CAB) for younger disabled students 
aged three to fifteen years can be 
useful (Lombardi, 1980). For those 
adolescents and adults suspected 
of lower intellectual functioning, 
psychiatric disorders, and social 
disadvantagement, the Street Survival 
Skills Questi onnai re is suggested 
(Halpern, et al , 1982). The lack 
of appropriate social skill more 
often than lack of job skills has 
been i denti f i ed as a major reason 
handicapped student's do not keep 
jobs upon leaving school (Brolin, 
1973; Mori, 1979). Therefore, the 
assessment in the social -emotional 
area is i m porta nt for successful 
work adjustment. 
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Interest 

The well-known and commonly used 
interest inventories such as the Strong 
Vocational Interest Blank and the 
Kuder would probably be of limited 
useful ness here because of their dependence 
on verbal abilities (Brolin, 1982). 
Even with reading each item to the 
student, the results would be invalid 
if the student did not have a highly 
developed receptive language, in addition 
to changing the normative data standardi- 
zation procedures. Picture inventories 
may be more appropriate tools for 
eliciting valid information from some 
handicapped students. Two such picture 
inventories have been developed specifi- 
cally for use with and normed on the 
retarded: Reading Free Vocational 
Interest Inventory (Revised) and Vocational 
Interest and Sophistication Assessment 
(visA). The former test measure high-low 
vocational interest in thirteen job 
clusters and the later measure job 
knowledge in each area in addition 
to interest in ten areas (Parnicky 
& Presnall, 1980). For more complex 
picture interest inventory, the Geist 
Picture Interest Inventory contains 
detai 1 ed pictures of hi gher level 
occupations (Brol in, 1982) . Designed 
for and normed on low literate persons 
is the Wide Range Interest Opinion 
Test (WRIOT)Revised (Alcorn & Nicholson, 
1975). 

Vocational Aptitude 

In the assessment of aptitude 
for certain vocational tasks requiring 
motor coordination, some measure of 
dexterity is generally given. The 
choice of the instrument depends on 
the type of dexterity to be measured. 
For example, the Purdue Pegboard measures 
gross movements of hand, fingers, 
and arm as well as tip of finger dex- 
terity. Crawford Small Parts Dexterity 
Test measures fine eye-hand coordination 
and the Minnesota Rate of Manipulation 
Test assesses arm- hand dexteri ty. 
Bennet hand Tool Dexterity Test measures 
proficiency in using ordinary mechanics 



tools, thus assessing both mechanical 
ability and previous experience in 
handling tools. According to Overs 
(1970), standardized tests of manual 
dexterity predict as well as job 
sample tasks and may be administered 
in a much shorter time. Additionally, 
the admi ni strati on of a dexteri ty 
test is also a learning experience 
for the handicapped student--as in 
the adult worl d , industries also 
admini ster dexterity tests for appl icant 
sel ection. 

Work Evaluation Systems 

The market- pi ace is saturated 
with commercial work evaluation systems 
which are for the most part costly 
and time consuming to administer 
in their entirety. The advantages 
of using such a system, however, 
are that it (1) tends to motivate 
students because the work samples 
are more like real job task than 
paper and pencil assignments; (2) 
provides important observation information 
that can help to predict functional 
abi 1 i ty; (3) provides experiences 
for hands-on testing following oral 
directions; and (4) allows for experiences 
that will be helpful in program and 
career planning (Scott & Sarkees, 
(1982). According toTellefsen (1982), 
the most rel iable vocational information 
is ( form long-term observation in 
an actual work and interactional 
social behaviors. Although the most 
effective method to measure vocational 
potential is job try-out, it is also 
the most expensive and often the 
least feasible; therefore, the work 
sampl e approach provi des a higher 
predictive val idity than does standardized 
paper and pencils tests (Mutter & 
McClung, 1981). 

Locally Produced Work Samples 

The purchase of a commercial 
work eval uation system to use the 
work sample form of assessment is 
not necessary. Work samples may 
be locally developed to represent 
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jobs that actually exist within the 
specific region. Work sample development, 
however, is a tedious process which 
requires time to establish local norms 
(Sitlington & Wimmer, 1978), Work 
samples could be administered and/or 
developed by vocational education 
teachers and counselors or vocational 
rehabilitation personnel. 

Suunary 

Vocational assessment is an integral 
component in the process of providing 
handicapped students skills for employ- 
ability, independence, and successful 
. life adjustment. When psychological 
reeval uations contain vocational compo- 
nents, data can be generated for use 
in career/ vocational planning, the 
inclusion of the vocational data into 
the written psychological report should 
not significantly alter the format 
of the report, but should be integrated 
into the different phases of the report. 
Thus, vocationally relevant conclusions 
and recommendations will be written 
with other summary statements and 
suggestions (Levinson & Shepard, 1982). 
The school psychologist is a part 
of the multi-disciplinary evaluation 
team that can make a significant impact 
on the career/ vocational directions 
of handicapped students. 
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EVALUATION OF PREVOCATIONAL SKILLS 
IN PUBLIC SCHOOL SETTINGS 



RICHARD D. PHELPS 



ABSTRACT: There is an increasing demand 
among employers for workers to demonstrate 
proper prevocational related concepts 
prior to entering the world of work. 
This is particularly true of students 
who have limited academic abilities 
and thus may have difficulty acquiring 
needed technical information. This 
article will outline the more critical 
prevocational skills, indicate methods 
of assessment in a vocational evaluation 
situation, and remediation in special 
education settings. 



Vocational evaluations of handicapped 
students in school settings are becoming 
i ncreasi ngly popul ar nationwide . 
These eval uations usually take place 
in the ninth or tenth grades and 
can greatly assist in determining 
occupational preferences , indi vidua! 
learning styles, and vocational aptitude 
levels. Because of this, school 
officials can, by means of the I.E. P. 
process, determine vocational placement 
alternatives in the least restrictive 
environment. This process can also 
be extremely helpful for devising 
methods of providing feedback to 
instructional staff concerning concepts 
typi cal ly defined as prevocational 
skills. This article will list some 
of the most common prevocational 
skills and suggest methods for their 
assessment and dissemination to special 
education instructional staff. 

What are Prevocational Skills? 

Prevocational skills may be 
defined as the battery of traits, 
qual i ties , and atti tudes typically 
desired of employees in working situ- 
ations. Thi s rices not incl ude the 
more complex technical skills a person 
may acquire in vocati onal training 
programs or through experience in 
a speci f ic occupation . Listed bel ow 
are some of the more commonly indicated 
prevocational skills based upon employer 
interviews and industrial surveys. 



1 
2 
3 
4 
5 
6 
7 
8 
9 
10 

11 
12 
13 
14 
15 



Punctual ity 
Attendance 

Respect of supervision 
Work quality 
Neatness 

Attending to task 
Organization of work 
Getting along with others 
Occupational awareness 
Physical conditioning and 
heal th 

Following instructions 
Maintaining an even disposition 
Basic communication skills 
Clean and neat appearance 
Honesty and dependability 
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16) Applying reading and arithmetic 
to working situations 

17) General safety practices 

18) Working independently 

19) Verbal communications skills 

Methods of Prevocational Assessment 

Many methods exist for the 
assessment of prevocational skills. 
One of the most frequently used methods 
involves long term observation in 
simulated working situations. An 
evaluator can present the student 
with various locally developed work 
sampl es or job tasks and can record 
the frequency of certain prevocational 
behaviors over an extended period 
of time. Unfortunately, this method 
of assessment is becoming "less feasible 
due to evaluation time constraints 
and increased numbers of students 
referred for assessment. Instead 
of abandoning the idea of prevocational 
skill assessment completely, substitute 
methods may be used to gain needed 
information without large amounts 
of time being involved. Several of 
these methods are described below. 

First, an evaluator may select 
a work sample system which includes 
sections devoted to behavioral observation 
in critical areas. Examples of these 
systems are the Jewish Employment 
Vocational Service Work Sample System 
(1973), the VALPAR Component Work 
Sample System (1974), and the McCarron- 
Dial Work Evaluation System (1976). 
Besides giving an evaluator critical 
information regarding vocational aptitude 
levels, these systems, and others, 
provide a format by which some of 
the indicated prevocational concepts 
can be observed, recorded and compiled 
in an effort to establish certain 
behavioral patterns. 

Second , specific , prevocational 
related, evaluation test may be utilized 
to gain information regarding some 
specific concepts. The Street Survival 
Skills Questionnaire (1976) and the 
VALPAR Prevocational Readiness Battery 
(1980) are examples of these tests 
which may be purchased separately 



and can be included in an existing 
vocational evaluation process. 

Third, a specific checklist 
may be utilized to pinpoint specific 
prevocational concepts which are 
in need of remediation. Exam pi es 
of such checklists include the MDC 
Behavior Identification Format (1974) 
and the Hamilton County (Ohio) Work 
Study Program Student Profile (Kaplan, 
1977). These checklists along with 
other similar models available are 
extremely useful because they not 
only allow for completion during 
the evaluation process but can be 
utilized at subsequent dates to indicate 
student progress in specific areas. 

Fourth, a prevocational checklist 
may be completed prior to the vocational 
evaluation or during the intake/orien- 
tation process. With this method, 
a speci al education teacher, school 
counselor, or an evaluator can quickly 
com pi ete a form by means of past 
observations, student interviews 
and/or school records. This type 
of format is particularly helpful 
in situations where evaluation time 
is 1 imi ted. Fi gure 1 contains an 
example of such a checklist which 
may be utilized or may serve as a 
basis for the development of a model 
which is speci fi c to the needs of 
an individual school system. 

Evaluator Input to Special Education 
Curriculum Planning 

As professional s knowl edgeable 
in the world of work and the demand 
of empl oyers , Vocational Eva lua tors 
can be of valuable assistance to 
spec ial educators in the area of 
curricul urn devel opment. Based upon 
vocational ly re 1 a ted strengths and 
weaknesses indicated in the assessment 
process, the evaluator may be able 
to offer suggestions as to the remediation 
of certain prevocational concepts. 
Hi nts may al so be given as to some 
critical skills needed by students 
prior to entering vocational training 
or working situations. This may 
assist the special education teacher 
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Figure 1 



Intake/Referral Form 



Full Name_ 

Grade 

Address 



NicknOT:2 



Date 



Class PI acement/Exceptional i ty_ 
Phone 



Father 1 s Name 

Mother's Name 

Achieve c?nt Data: 



J)ccupation_ 
"Occupation^ 



^Emergency Phone_ 
Phone 



Phone 



Ari thmetic_ 

Readi ng 

Vocabul arv 



Social Maturity Level 

Attendance: School Year 84/8S_ 
School Year 83/84_ 
School Year 82/83_ 

Medical /Phys ;cal Li mi tat ions 

Medication (If any) 



_Source_ 
Source^ 
_Source_ 
_Source_ 
Source 



^Number days absent_ 
"Number days absent^ 
"Number days absent 



Jardy_ 
_Tardy_ 
Tardy_ 



Indicated Occupations of interest 



Indicated Vocational Programs of interest_ 

Past Vocational Training " 

Past Employment 



Please Check 



Move quickly and effu: 
between work tasks 



• My 



Has necessary materials ready 

Completes tasks quickly 

Works independently without 
unnecessary assistance 

Completes tasks efficiently/ 
accurately 

Follows through with tasks 
until complete 

Attending to tasks 

Continues work tasks when 
teacher is out 

Follows verbal instructions 

Follows written instructions 
commensurate with reading 
1 evel 

Follows a model or diagram 

Handles equipment safely/ 
properly 

Honesty 



very ap- 
propriate 



adequate 



i nap- 

propr iate N/A 



Comment 
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very ap- inap- 

propriate adequate propriate N/A Comment 

Dependabi 1 i ty/Trustworthy j~ ] [ ~ 

Level of self confidence 

Easily frustrated by 
di f f icul t tasks 

Easily bored by repetitive 
tasks 

Demonstrates good study 
skills 

Completion of homework/ 
outside assignments 

Accept? new tasks without 
compl ai nt 

Courteous/good manners 

Maintaining good health 
practices 

Clean and neat appearance 

Works well with other 
students 

Displays respect for 
supervi si on 

Accepts constructive 
cri tici sin 

Effectively communicates 
needs 

Performs work neatly 

Cleans up after work tasks 

Properly organizes work tasks 

Can complete personal 
information fonn 



Has student been referred to school officials for discipline related problems? 



Briefly explain: 



Has student made recent progress in areas related to discipline problems? 
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in combining the teaching of basic 
academic competencies with needed 
functional concepts which may serve 
to increase student motivation and 
increase the learning process. Listed 
below are a few hints and suggestions 
possibly gained from assessment. 
Although certainly not complete, they 
may serve to generate the development 
of creati ve i nstructional pi anni ng 
relating to prevocational skill s develop- 
ment. Also included is a listing 
of general recommendations which an 
evaluator may find helpful to include 
in an assessment report to school 
officials. 

1) Bringing industrial representatives 
to the cl ass room to di scuss 
concepts required for working 
i n particular settings . Have 
these representatives discuss 
the traits, qual i ti es , and 
attitudes needed along with 
academic requirements and 
opportunities for advancement. 

2) Devel op si ides showing individuals 
actual ly per form i ng jobs in 
the 1 ocal community. Discuss 
dress requirements, environmental 
demands , skills bei ng used , 
physical qualities of workers, 
safety concepts, and level 
of supervision. 

3) Look beyond the area of home 
economics and science when 
teaching liquid measures. 
I ncl ude act i vi ties rel ati ng 
';o food service , mechanics , 
pi umbing , and custodial occu- 
pations . 

4) Writing and punctuation skills 
can be further developed with 
job appl i cations , insurance 
forms , invoices and inventory 
control forms . 

5) Increase sight word vocabulary 
and phonetic skills with terms 
common to industry in the 
geographical area. 

6) Dictionary usage activities 
can be expanded to include 
tool catalogs, parts books, 
wholesale order pamphlets, 
and Department of Labor texts. 
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7) Expand activities using the 
yellow pages to areas and 
locations of potential employers. 

8) Utilize the city map to chart 
certain delivery routes used 
by employees of distributing 
compani es : soft dri nk , beer , 
office supplies, commercial 
foods, lumber, welding supplies, 
etc. . .) 

9) Expand the terms used in 
safety activities to incl ude 
works, phrases, and procedures 
common to local industry. 

10) Plan activities which encompass 
the entire process of locating 
and securing employment. 

11) Visit local industries in 
order to have students 1 earn 
first-hand information pertaining 
to job securing and job retaining 
skills from individuals who 
actually do the hiring and 
firing of workers. 

12) Utilize activities which 
allow for the transfer of 
critical math activities. 
These include: 

a. Complete stock requisition 
forms 

b. Compute sales tax 

c. Complete inventory control 
forms and compute gross 
and net value of stock 
or materials on-hand 

d. Determine discounts and 
whole sale/retail price 

e. Compute overtime payments 
and rates of pay 

f. Util ize vocational activities 
relating to fractions, 
decimal s , and the metrics 
system 

13) Incorporate the concepts 
of personnel budgeting with 
budgeting practices associated 
in runni ng a smal 1 business 
such as lawn care, home banking, 
and newspaper delivery. 

14) When teaching linear measure, 
i ncor porate actual measuring 
instruments encountered in 
industry. Also utilize the 
concept of closure. If a 
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student is to measure a stock 
of wood, have her/him cut 
the wood with a hand saw. 
15) Objectives relating to personal 
health care can be expanded 
to include skills needed for 
workers in child care and 
health occupations. 

POTENTIAL RECOMMENDATIONS FROM EVALUATION 
TO LOCAL SCHOOL OFFICIALS 

Practical home and work related science 
concepts 

Dressing and grooming for employment 

situations 
Budgeting and consumer economics 
Increased sight work vocabulary of 

basic survi val and occupational 

terms 

Familiarization with methods of seeking 

employment 
Interview techniques 
Familiarization with services offered 

by public agencies (VRS, etc.) 
Methods of keeping employment and 

job advancement 
Comprehension of fractions and linear 

measures to 1/16 inch 
Detailed knowledge of personal data 

in order to complete occupational 

and practical living forms 
Familiarization with basic hand and 

power tools and their usage 
Making change and counting money 
Telling time 
Using a calendar 

Using the telephone for calling, answering, 

and taking messages 

Alphabetically arranging by letter 

Serially arranging by number 

Job safety practices 

Driver education 

Simple message writing 

Reading dials, gauges, and thermometers 

Simple sorting by physical property 

(color, size, etc.) 
Reading road signs 
Using a telephone directory 
Famil iarization with basic units of 
measure 

Awareness of di fferent occupations 

and individual concepts of each 
Utilizing the resources of a local 



newspaper 
Work quality and neatness 
Punctuality and attendance 
Intensive physical education program, 

emphasizing endurance, speed and 

strength development 
Work with peers and supervision in 

a cooperative manner 

NOTE: 

When including a bove information 
on eval uation reports , it may be 
helpful to draw a short line in the 
left column in order to indicate, 
by checkmarks, those areas which 
are in particular need of remediation. 
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THE REGIONAL VOCATIONAL ASSESSMENT 
CENTER: MEETING HIGH SCHOOL STUDENT 
VOCATIONAL NEEDS 



DEBRA L. KAPLAN 



ABSTRACT: While Individual Education 
plans contain a vocational component 
for older handicapped students, this 
component, unlike academic components, 
is often designed with little, if 
any, assessment information. Because 
of the high cost of providing compre- 
hensive vocational assessment services 
within a school district and because 
of the paucity of trained vocational 
educators in the Pacific Northwest, 
few districts conduct meaningful vocational 
assessments with their students. 
In some districts, personnel are forced 
to assume evaluation duties for which 
they were not adequately trained. 
This situation often leads to inefficient 
evaluation programs and frustrated 
professionals. 

Washington State recognized the 
need for comprehensive vocational 
evaluation services and so the Office 
of Superintendent of Public Instruction 
(OSPI) funded RVAC — the Regional 
Vocational Assessment Center. OSPI 
funding and University of Washington 
expertise have produced a model evaluation 
program that is meeting school district 
needs. Now Washington schools have 
the precise information their staff 
need to develop meaningful vocational 
programs for handicapped young adults. 

RVAC has assessed students from 
approximately 40 school districts 
in 18 months. RVAC has also evaluated 
individuals for foster care agencies, 
the Department of Rehabil itation Medicine 
at the University of Washington and 
the State Department of Vocational 
Rehabilitation. Evaluees include 
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teenagers and adults with a variety 
of disabling conditions incl uding 
developmental disabil ities , neurological 
impairments , physical impairments, 
and persons with industrial orthopedic 
injuries. RVAC also assesses a large 
population of adjudicated youth as 
part of a trans i ti on project that 
prepares i ncarce rated teenagers for 
re-entry into the public school system. 

The Problem 

Public Law 94-142 encourages 
schools to provide all disabled students 
wi th vocational education. Leaders hi p 
and the movement to provide such 
education became aware of the need 
to support a student's vocational 
pi a cement wi th accurate information 
regarding his/her aptitudes and poten- 
tials. The notion was that the absence 
of such i nformation mi ght 1 ead to 
i nappropriate placements of students 
who would then be exposed to failure 
at their first vocational endeavor. 

The need for vocational assessment 
in the school s has been amply documented. 
In a survey of Texas educators , Peterson 
(1981) found that over 80% felt that 
comprehensi ve vocat i onal assessment 
was critical to develop appropriate 
educational programs for secondary 
age handicapped students. The National 
Association of Vocational Education 
Special Needs Personnel Committee 
on V oca ti onal Assessment (McCray , 
1981) indicated "all vocational training 
plans for special needs students 
shoul d be based on vocational assessment 
information" (p. 20). 

Establ ishing vocational assessment 
programs wi th i n school systems was 
a unique challenge for educators 
because vocational assessment , as 
we know it today, was primarily the 
invention of vocational rehabil itation- 
ists. If we assume that vocational 
assessment is a scientific process 
requiring not only skill s in measurement, 
but also trained counseling skills 
and a sensitivity to observed behaviors , 
then we must acknowledge the need 
for professionals trained in all 
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aspects of this process to develop 
and coordinate accountable and effective 
programs. School s attempting to replicate 
this process found it necessary to 
rely on the expertise of professionals 
within the field of rehabilitation. 
However, without policies for certifying 
these professionals, schools were 
abl e to pass the responsibil ity for 
de vel opment of assessment programs 
to various school personnel , such 
as special education teachers , vocational 
education teachers, school psychologists, 
etc. While these professionals were 
skilled in their areas of expertise, 
they did not have the knowledge needed 
to conduct vocational assessments 
or to develop comprehensive vocational 
assessment programs 0 Therefore schools 
relied on manufacturers of assessment 
instrumentation for training. 

When discussing the use of commercial 
work sample systems, Brolin (1982) 
stated "the critical shortage of trained 
evaluators created by the increase 
in demand has forced administrators 
to seek a 'system 1 instead of a qualified 
evaluator" (p. 133). He further asserted, 
"because of the shortage of qualified 
vocational evaluators, many evaluation 
programs just do not have the expertise 
to tailor and make their own work 
sample systems" (p. 136). While manu- 
facturers 1 training teaches the funda- 
mentals of the process, school pro- 
fessionals did net have the benefit 
of long-term training or working with 
a mentor through internships. Conse- 
quently, many school professionals 
were presented with a task which was 
often times beyond their level of 
expertise to design a vocational 
assessment program which coul d effectively 
measure the vocational abilities of 
1 arge numbers of students with varied 
disabilities and communicate the results 
to parents, students, and teachers. 

This is essentially what occurred 
in Washington State. Because of a 
lack of trained vocational evaluators, 
teachers found themsel ves in new positions, 
creating vocational assessment programs 
with little technical assistance. 
Several probl ems resulted. Although 
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students are being assessed, the 
i nf ormat i on was not be i ng used by 
classroom teachers to develop vocational 
programs, largely because they were 
not able to i nter pret the results. 
Also, in many cases the recommendations 
offered did not rel ate the programs 
available through the school district. 
All community resources and post-secondary 
training options available to the 
student were not reflected in the 
transition process for graduating 
students. Many eval uators found 
special education teachers resistant 
to recommendations and vocational 
education instructors opposed to 
inclusion of disabled pupils in their 
cl asses. Consequently, vocational 
evaluation reports were filed after 
failing to offer vocational direction. 
Many school districts found evaluation 
equipment collecting dust while school 
prof ess i onal s and parents remained 
di si 1 1 usi oned regarding the subject 
of vocational assessment . While 
1 arger di stri cts have been abl e to 
design and maintain effective programs 
by employing persons trained in vocational 
eval uat ion at 1 e a ding institutions , 
small c districts are unable to provide 
this iuuch needed service to their 
special needs students . Hence , many 
students are at risk for being placed 
inappropriately and for 1 eaving high 
school with few vocational skills 
and little knowledge of resources 
available for post-secondary training. 

The Solution 

In answer to this dil emma , the 
Regional Vocational Assessment Center 
(RVAC) was established in 1982 at 
the University of Washington to meet 
the needs of the many school districts 
that are unable to provide assessment 
servi ces to di sabl ed students . The 
concept of a. regional evaluation 
center was realized by the University 
of Washington and the Office of the 
Superintendent of Publ ic Instruction 
as a means of offering 1 ow cost , 
ef f i cient services for many school 
districts. Being located at the 
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University of Washington allows the 
Center to draw upon many resources, 
including specialized training centers 
for handicapped adults and on-campus 
work stations. RVAC was designed 
to serve persons with a large variety 
of disabilities, including students 
with learning disabilities, behavior 
disabilities, those that are develop- 
mental ly del ayed , orthopedically impaired, 
neurologically impaired, juven i 1 e 
offenders, youths in foster care, 
industrially injured adults, and handi- 
capped adults referred by the Department 
of Vocational Rehabilitation. 

In designing the program, great 
emphasis was placed on the service 
delivery model to ensure accountability 
and integration with large numbers 
of school districts. Therefore, the 
model was designed to maintain flexibility 
so that the program could be modified 
to meet the needs of such diverse 
populations as incarcerated youth, 
the devel opmental ly disabled, and 
students from rural environments. 

Pre- Assessment Meeting 

Prior to assessing students, 
and in order to ensure accountability, 
each school district that refers students 
to the RVAC for an assessment is visited 
so that program availability and entry 
requirements for existing programs 
can be determined. While this is 
a simple procedure in some districts 
many districts have no specific vocational 
programming available for disabled 
students. In such situations, the 
evaluator works with the referral 
source to 1 ocate possi bl e traini ng 
options on campus and in the community. 
In many cases, the evaluations are 
used as a needs assessment by districts 
so that programs can be designed to 
meet the specific training needs of 
the student population. The pre-assessment 
visit is one of the most significant 
aspects of the model because it increases 
the probabi 1 ity that recommendations 
reflect program availability. A vocational 
plan of action can be grossly ineffective 
in spite of a seemingly brilliant 
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design if it requires resources beyond 
the capability of the district. 

Referral 

The referral process at the 
RVAC was des i gned to be s impl e but 
compl ete . A referral form requests 
for each student a description of 
the voca ti onal devel opment probl em , 
specific questions which need to 
be answered by the assessment, and 
basi c data necessary to understand 
the needs of the student. Such data 
i ncl ude the resul ts of psychometric 
tests and information regarding, the 
disabling condition, physical limitation, 
expressed and/ or tested i nte rests , 
work experience , leisure time activities 
and social / environmental background. 
Recent psychological , medical , or 
neuro- psychol ogical reports are re- 
quested. Referral sources also submit 
the student 1 s most recent indi vidual 
education plan. Some special education 
teachers are unfamiliar with vocational 
assessment, and in such cases, the 
referral form is completed with the 
evaluator so that the teacher can 
learn what to expect from an evaluation. 
This has proved to be an effective 
educational process for teachers 
and guarantees that the eval uation 
will meet their expectations. It 
also encourages teachers to refer 
students for specific reasons, rather 
than for general assessment, which 
usually eludes foM ow- through. 

Evaluation 

At RVAC, a 4:1 cl ient-to-eval uator 
rati o is mai ntai ned , and a 4- day 
evaluation period is the accepted 
norm. However, scheduling is flexible, 
given the variable work speeds of 
the cl ient population. The 5th day 
is used for report writing. 

Upon arrival at the center, 
all students are given an orientation 
as well as a brief tour of the faci . ity. 
An initial interview is conducted 
with each student. This interview 
is a crucial part of the eval uation 
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since it is used to establish rapport 
with the students and to validate 
data included in the referral form. 
During this first meeting, the evaluator, 
along with the student, completes 
an Individual Evaluation Plan (IEP) 
which outlines what will take place 
during the assessment, and lists work 
samples and tests that wil 1 be administered 
to answer the referral questions. 
This process has been found to be 
extremely effective as it involves 
a student in the decisionmaking process. 
In fact, students are encouraged to 
work independently and to make decisions 
throughout the evaluation. In many 
cases , we find that students are surprised 
and a bit uneasy when having to make 
decisions regarding their own education. 
Some students find the independent 
responsibility assumed at the assessment 
quite unusual, given the rote schedules 
they maintain at school. 

RVAC utilizes paper and pencil 
psychometrics and commercial evaluation 
systems such as JEVS and Valpar as 
well as self-developed work samples 
to assess students. While the model 
does not discourage a generalized 
approach to vocational assessr^nt , 
it does not sanction administration 
of all work samples to an indivlcual. 
Utilizing a prescriptive format, students 
are only administered those work samples 
that will answer the questions included 
on the referral form or those hat 
will increase the student's exposure 
to occupational domains where he or 
she has suggested an interest. 

Post sample interviewing enco • .ges 
students to express feel is/" ...out 
a certain activity and to make a decision 
about whether or not they would want 
to perform this type of work in a 
job. Again, students are encouraged 
to make decisions throughout the assess- 
ments since this is an essential element 
in vocational development that usually 
goes unstressed in the school environment,, 

Many students lack exposure to 
the world of work and find it difficult 
to engage in discourse regarding the 
topic. Their perceptions have been 
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influenced by their lifestyles, which 
may include unrealistic ideas about 
common occu pat ions. (We have seen 
students who associate Magnum P.I. with 
private investigation and are therefore 
interested in this as an occupational 
goal.) In order to increase the 
students' awareness of the work world, 
group and individual val ues clarification 
exercises are used to promote open 
discussion about issues such as job 
satisfaction , salary and benefits, 
work environment, etc. Students 
are also taught to conduct occupational 
research by using a structured interview 
to find out about jobs held by friends 
or relatives. Through this method 
students are taught to converse with 
others in a professional manner and 
to inquire about necessary information 
such as specific job tasks, specialized 
equipment, training and qualifications, 
remuneration , and job availabil ity. 
Students are encouraged to use these 
techniques when searching for employment 
or making a decision about a specific 
occupation. 

To meet the needs of specific 
populations , the evaluation process 
and the instrumentation is continually 
modified. For instance, developmental! y 
delayed individuals are frequently 
re administered specific work sampl es 
to assess learning ability through 
practice and the use of specific 
training strategies. While destandard- 
izing tests administrations invalidates 
normative data, this strategic method 
of assessment is particularly important 
for this population given their failure 
on traditional assessment batteries. 
Al 1 modi fi cat i ons are descri bed i n 
the vocational eval uation report . 
RVAC has al so devel oped work samples 
which measure the entry level abilities 
needed to be eligible for post-secondary 
training programs for devel opmentally 
disabled adults. This results in 
replication of the training methods 
used in these programs to predict 
cl ient success. 

An i nterim i ntervi ew midway 
through the evaluation is used to 
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modify the IEP if necessary. During 
the exit interview, the evaluator 
shares results with the school district, 
community or adult agencies. The 
student and the evaluator together 
design vocational options for the 
student which will be described in 
the evaluation report and shared at 
a staffing following the assessment. 



The Vocational Plan 

Col 1 ecti ng information regarding 
a student's vocational potential is 
only part of the evaluation. Far 
more crucial is the way the infor- 
mation is interpreted and presented. 
This is why an evaluator':: counseling 
and resource skills are so important. 
If a person's vocational skill level 
were the only predictor of vocational 
success, the chore would be simple. 
However, a variety of factors determine 
success, including motivation, job 
seeking skills, independent problem 
solving, job availability, etc. 

All of these factors are considered 
during the highly individualized process 
of plan development. Occupational 
research and investigation of community 
programs or agencies is often performed 
by the evaluator to determine the 
likelihood of an individual's success, 
or to locate specific services needed 
to enhance a student's vocational 
skills. This way, the evaluator can 
be certain that recommendations are 
based on available resources. Also, 
rather than reporting only evaluation 
results and general recommendations, 
the evaluator offers the student and 
teachers a prescriptive plan for vocational 
development. For instance, reconmendations 
for developmental ly disabled students 
not only include occupational areas 
for training, but also specific training 
strategies which may produce competitive 
employment skills with individual 
students in either skill acquisition 
or work adjustment. 

The evaluator must be responsible 
for creating a vocational plan of 
action which ca n be implemented. 
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A vocational eval uation special ist 
must understand the relationship 
between evaluation results and imple- 
mentation of habilitation plan. 
Therefore, the evaluator must use 
counsel ing, testing, and behavior 
observations to assess students and 
to identify a vocational path. For 
instance, a student may possess skills 
at a competitive level , but a lethargic 
approach to the evaluation and school 
work in general may indicate potential 
f ai 1 ure in a job . Thi s , al ong wi th 
recommendations for remediation are 
communicated to the student and the 
referral source. 

The Staffing 

Each student evaluated at RVAC 
attends a staffing along with parents 
and/or guard ians, the evaluator, 
and significant school personnel , 
i ncl udi ng teachers , psychol ogi sts , 
etc. The staffing is used to communicate 
and explain test results and recommen- 
dations which are contained in a 
narrative style report and distributed 
to all in attendance. More importantly, 
however, the staffing is used to 
modify any recommendations that may 
be unreal istic and to sol ve probl ems 
that may be associated with implementing 
the plan. All who attend the staffing 
are asked to respond freely with 
suggest i ons for improving the pi an 
since they are usually better acquainted 
with the student's history and behavior 
and will also be instrumental in 
following through with the plan of 
action. Before the staffing is ter- 
minated, the next step in habilitation 
process is identified along with 
the persons responsible for carrying 
it out. 

Follow-up 

A brief fol 1 ow-up questionnai re 
i s compl eted by each referral source 
a ppro ximately 6 months after the 
evaluation takes place. Occasionally, 
RVAC is consulted later in the training 
process if the plan has been unsuccessful 
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and modifications are necessary or 
just for input when the student's 
program is at a turning point. 



Impact 



RVAC has had a great impact on 
the education of di sabl ed students 
in its first two years of operation. 
One of the most significant aspects 
of the service delivery model is that 
it operates from a non-biased objective 
position as a centrally located resource 
for many school districts. This has 
been found to be extremely effective 
wi th school di stri cts , parents , and 
human service agencies, as the evaluator 
is able to maintain clear objectivity. 
The model has proved that an outside 
consultant has greater success at 
offering recommendations than a 
school-based evaluator because he 
or she is able to discuss sensitive 
habilitation issues that school personnel 
may feel uncomfortable with, given 
their close relationship with the 
student's family and their professional 
peers . 

Confronted with initial resistance 
from school districts reluctant to 
use assessment because of previous 
disappointments, RVAC has educated 
many professionals and parents about 
accountable assessment and referrals 
tripled during the second year of 
operation. 

A follow-up study conducted after 
the f i rst year of operation received 
an 86% response rate. The study indicated 
that 50% of the referral sources were 
abl e to impl ement the vocational pi an 
of action. The other 50% were unable 
to implement the plan because students 
left the district or the responsibility 
had shifted to another professional 
who had not been i nvol ved i n the eval uation 
process. Eighty-six percent stated 
that vocational pi ans were based on 
available resources and 100% stated 
that they would utilize RVAC's services 
again. 
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Conclusion 

At the present time there is 
no establ ished model for vocational 
assessment within the schools. While 
several models have been tried and 
professionals debate the assets and 
1 imitations of proposed model s , a 
standard format has not been designed, 
tested, and adopted. 

The Regional Vocational Assessment 
Center operates with a model which 
offers low cost, highly individualized 
and accountable services to many 
school districts through a central 
location in Washington state. 

There are several goals that 
the RVAC plans to achieve in the 
future. First, while this model 
has proved to be effective, it has 
not been subjected to statistical 
scruti ny through research. Also, 
its location 1 imits its service del ivery 
to a speci f ic geographic region and 
additional regional centers are needed 
in strategic locations throughout 
the state. Projects related to both 
these issues will be considered. 
Secondly, vocational assessment i n 
the schools now takes on even greater 
importance with the federal government' s 
new emphasi s on trans i ti on , si nee 
evaluation is actually a link between 
a student and services. The RVAC 
hopes to conti nue its invol vement 
in the transition process by utilizing 
vocational assessment as 1 inkage 
between secondary and post- secondary 
vocational training programs. 

With support from the state, 
RVAC has been able to offer direct 
service to school districts and their 
students. However, in keeping with 
their current policy to grant funds 
for direct service to school districts 
only, the RVAC 1 s fundi ng has been 
cut considerably. The response from 
districts who have relied upon services 
from the RVAC has been overwhelm!" ng 
and RVAC will be able to continue 
operating with support from districts 
who have recognized that vocational 
assessment is crucial in the vocational 
development of handicapped youth. 
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SERVICES OF A SPECIAL NEEDS EVALUATION 
CENTER: HOW USEFUL ARE THEY TO A 
VOCATIONAL INSTRUCTOR? 



KENNETH U. BOHNENSTIEHL 



ABSTRACT: This research project addresses 
services derived from vocational evaluation 
and examines their useful ness to vocational 
instructors working with special edu- 
cational students. 

The study shows that traditional 
interpretations of vocational evaluation 
data are useful and can be further 
interpreted to provide instructors 
with valuable information. 



Statement of Problem and Rationale 

Mai n streaming special education 
students in regular classes has caused 
concern to regular education teachers. 
"What can we do with these students?" 
is a question often asked by regular 
educators. Mai nstreami ng special 
education students vocational programs 
generates similar questions and concerns. 
To assist a teacher receiving a main- 
streamed special education student , 
information on that student's strengths 
and weaknesses must be presented 
to help answer these questions. 
When placement into a vocational 
program is considered a vocational 
evaluation of the student is conducted 
and this information is also presented. 

In order to help provide information 
for the IEP committee and instructors, 
the Mobile County Public School System 
in Mobile, Alabama, offers vocational 
evaluation to all special needs students. 
T.L Faulkner Area Vocational School 
(Faulkner) houses a Special Needs 
Vocational Eval uation Center (Evaluation 
Center). This center offers many 
services to the vocational instructor, 
some directly and other indirectly, 
with most of the services being derived 
from vocational evaluation data. 

Purpose and Objectives 

What servi ces are most useful 
to a vocational instructor for working 
wi th a speci al education student? 
Determining the answer to this question 
is the purpose of this research project. 

Objecti ves are used in t hi s 
study to state the research problem. 
Borg and Gall (1979) state that when 
a researcher is unable to predict 
the results of a study, objectives 
may be used instead of stating a 
hypotheses. By using objectives , 
it is hoped that tentative hypotheses 
will be generated which will be useful 
in future research. 

The research objectives for 
this report are: 

1. To determine the relative 
usefulness of services provided 



134 



ERLC 



147 



by the Special Needs Vocational 
Evaluation component. 
2. To generate hypotheses for 
further research in vocational 
education of special education 
students. 

Methodology 

Prior to the interview of vocational 
instructors, the areas of assistance 
provided by the Evaluation Center 
were identified and isolated by type 
of services. These services were 
listed individually on index cards, 
forming a packet of cards, used in 
the formal interview. 

Subjects 

Vocational instructors, who have 
vocationally evaluated special education 
students enrolled in their programs, 
were the subjects of the formal inter- 
view. These instructors were identified 
by comparing their class rolls with 
student rolls from the Evaluation 
Center. 

Format 

A personal interview was conducted 
with each identified vocational instructor 
to explain the purpose of this study 
and to obtain data to meet the state 
objectives. An interview format was 
selected for collecting information 
for this study because it provides 
a one-to-one personal contact between 
interviewer and interviewee. Research 
indicates (Borg & Gall, 1979) that 
the interviews format will provide 
better response than a questionnaire 
format. Interviewees also have the 
opportunity to ask for an explanation 
of a question before responding and/or 
to give a more in-depth response to 
the question. 

During the interview, the cards 
listing services were shown to the 
interviewee. He/she was asked to 
order the service cards by ranking 
those most useful to their working 
situation with special education students. 
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Cards were ranked with the service 
felt most useful by tYa interviewee 
placed first on the left progressing 
ordinally with the least useful service 
to the right. Standardized instructions 
for the rank ordering of these cards 
were given to all interviewees. 

The rank order procedure for 
analyzing data collected was selected 
because this procedure works wel 1 
when the number of items to be ranked 
is less than 25 (Fox, 1979). Responses 
of the extremes will show strengths 
and weaknesses of services as the 
i nterviewee percei ves them. Servi ces 
were then tall ied by rank positions 
from each interview to show an overall 
ranking order. 

This composite tally illustrates 
which services have the most and 
the least usefulness to the subjects. 
A determi nation can now be made as 
to how services can be added or improved 
to meet each subject's needs. 

Results 

There were nine vocational instruc- 
tors from a staff of fourteen who 
met the requirements for this study. 
All nine vocational instructors were 
interviewed. All of the interviewees 
were told that the purpose of the 
interview was to obtain their input 
on the usefulness of Evaluation Center 
Services. All of the interviewees 
stated that they understood the rank 
ordering procedure and each interview 
was conducted without any problems. 

Delimitations 

A delimitation for this study 
was that only one vocational school 
was used. Faulkner was the only 
area vocational school in Mobil e 
County Public School System that 
had an operating special needs vocational 
eval uation center. 

The composite tally of each 
interviewee 1 s response to those services 
from the Evaluation Center felt to 
be most useful and 1 east useful to 
their situation for working with 
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special education students is shown 
in Figure 1. Individual interviewee 
responses and their identity were 
handled in a confidential manner. 
Figure 1 shows how each interviewee 
rank order each service, but it is 
difficult to determi ne clustering 
of responses for those services felt 
most useful and least useful by the 
interviewee. 
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Rank-ordered response for each 
question were then grouped into cells 
and compressed into three categories: 
(a) most useful (rank order positions 
1 through 3), (b) neutral (rank order 
positions 4 through 6), and (c) least 
useful (rank order positions 7 through 
9) . Figure 2 shows the interviewee 
responses as percentages in each 
category for each Evaluation Center 
service rank ordered by the interviewees. 

Host services had some val ue 
to i ndi vidua! interviewees. Looking 
at Figure 2, services three and four 
have the highest percentage of being 
rank ordered most useful to the inter- 
viewees : ,! pl acement recommendations 
and vocational IEP development, respec- 
tively. ,! Those services with a high 
percentage of being rank ordered 
as least useful were services six 
and seven; "representation at IEP 
meeting and evaluator as a resource, 
respectively." 

Discussion and Implications for Future 
Research 

Objective 1 for this study was 
achieved. The relative usefulness 
of each service provided by the Evaluation 
Center, as derived from vocational 
eval uation data , was determined. 
All services had some degree of useful- 
ness, ei ther posi ti ve or negative , 
to the individual vocational instructors 
in this study. While tv:o of the 
services were ranked high in the 
survey as being most useful, other 
services may have been perceived 
as being equally useful, but 4 he 
interviewees wero forced into a choice. 

A follow-up with the vocational 
instructors who participated in this 
study woul d ascertain all of the 
services felt to be useful to them 
i ndi vi dual 1 y . Future efforts of 
the Evaluation Center should be directed 
to providing those particular services 
felt to be most useful to those individual 
vocational i n struct ors to assist 
them in working with special education 
students. 
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Objective 2 for this study was 
achieved. Hypotheses for further 
research can be developed from this 
study. Possible problem statements 
which coul d be used to generate hypotheses 
are: 

1. How do other vocational instruc- 
tors in similar settings feel 
about the usefulness of services 
provi ded by a speci al needs 
vocational evaluation center? 

2. Can other services be provided 
by the Evaluation Center that 
would " osist Vocational instructors 
i n teaching special education 
students? 

Summary 

This research project addresses 
services derived from vocational evaluation 
and how useful they were to vocational 
instructors when working with special 
education students. Vocational instructors 
identified as the population for this 
study were formally interviewed. 

First, services available to 
them from vocational evaluation data 
was listed on a pack of cards. During 
the interview, the vocational instructor 
was asked to rank order these services 
as to their usefulness for working 
with special education students in 
a vocational setting. 

A composite tally of the services 
as they were rank ordered by the inter- 
viewees showed how useful services 
were perceived. From this information, 
services to vocational instructors 
that are derived from vocational evalu- 
ations can be modified or improved 
to better assi st the vocational instructor 
in working with special education 
students. 

The timeliness of the topic of 
this study is in concert with the 
current interest in vocational education 
nationwide. Part of the federal monies 
sent to state education departments, 
monies for both special education 
and vocational education, are used 
as set-aside funds for the special 
needs population within each state. 
This study shows that not only are 



the tradi ti onal interpretations of 
vocational evaluation data useful 
to the instruction of special education 
students mainstreamed into vocational 
education programs, but that vocational 
eval uati on data can be interpreted 
to provi de many and varyi ng servi ces 
to personnel invol ved in vocational 
education of these students. 
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INTRODUCTION TO MICROCOMPUTERS 



RANDALL 3. HcDAKIEl 



ABSTRACT: it has become impossible 
to nick up any periodical , newspaper, 
or professional literr^ure without 
reading about the microcomputer revolution 
and it's coming effects on our personal 
and professional lives. Microcomputers 
have been called the fuel f the infor- 
mation age and the pencil of the eighties. 
From most accounts, it sounds as if 
through the simple pushing of a few 
buttons, anything we care to do is 
magically done for us by the microcom- 
puter. Unfortunately, the reality 
of microcomputer usage is not that 
simple 0 While microcomputers are 
nothing more than electronic machines 
that are not difficult to understand, 
much of their actual use is clouded 
in mystique and jargon, Therefore, 
the aim of this paper is to provide 
an explanation of the components, 
terms, and usage of these marvelous 
machines to cast you off into the 
computer revolution. 



Wnile the advent of the computer 
could be traced to the ancient abacus, 
the first computer was built after 
World War II by Army engineers intent 
on discovering a quick method of 
computi ng the trajectory of mi ssl es . 
Their first computer utilized vacuum 
tubes , occupied two entire floors 
of a building and employed' several 
people to constant ly change tubes 
which blew out on an average of once 
every four seconds. With all it's 
size, that first computer had less 
capacity than most of today 1 s micro- 
computers. The development of the 
mi cro computer can be taken back to 
the mid 1960's with the formation 
of the Amateur Computing Society 
whose goal was to pi ace computers 
in the hands of the general publ ic. 
This was closely followed in the 
late sixties with the development 
by the Intel Corporation of the first 
mi cro processor which moved computi ng 
circuits onto a small chip. This 
was followed by the first computer 
kit in 1971 and the first available 
microcomputer system in the mid seventies. 

There are currently four types 
of computers available which all 
work in the same manner, however 
they are classified by their size. 
Most people are familiar with the 
mai nf rame computers which general ly 
take up a large part of specially 
controlled room and have the capacity 
to handle many tasks at the same 
time (multitasking) and can handle 
a great number of users at the same 
time (multiuser). It is not unusual 
for a mai nf rame computer to have 
over 200 terminals hooked to it at 
remote sites and be working on thousands 
of operations. With a larger capacity 
are super computers which are used 
for gigantic number crunching problems 
as might be encountered in the space 
program . These supercomputers deal 
with billions of bits of data so 
rapidly that they take a mainframe 
computet- to input and output the 
data. One step down from the mainframe 
is a minicomputer which has multitasking 
and multiuser capability however, 
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they are generally set up for less 
than 20 i nput termi nal s . At the smal 1 est 
end of the scale are micro, alias 
home or personal computers which are 
typically set up to service a single 
user and perform fewer calculations 
in a si ower manner than the previous 
types. As computer size continues 
to shrink and capacity continues to 
increase, these divisions become in- 
creasingly diffuse to the point where 
it is expected that future computers 
may be as small as calculators and 
have the capacity of today's super- 
computers. One other artificial division 
among computers is the dedicated computer 
or microprocessor which is utilized 
to do only a few functions and the 
non-dedicated computer which can be 
programmed to do any function capable 
by a computer. A machine which only 
performs word processing is an example 
of a dedicated computer while a personal 
computer capable of playing games, 
working math, or doing word processing 
is an example of a non-dedicated computer. 

How Computers Work 

Computers are electronic machines 
which can only recognize electronic 
signals or current which is on or 
off. Thus, all information dealt 
with by the computer comes into the 
machine in a series of "on and offs", 
which can also be conceptualized plus 
and minus or 1 for on and 0 for off. 
Since such an elemental process is 
being dealt with by the computer, 
computer programmers util ize a system 
to communicate with the computer which 
exclusively uses the 1 for on and 
0 for off concept, known as the binary 
or base 2 system or arithmetic. In 
the decimal or base 10 system with 
which most of us are familiar, each 
successi ve number from the right represents 
ten times the number. Therefore, 
in the number 256, the six is in the 
uni ts pi ace and stands for si x times 
one, or six; the five is in the tens 
place and stands for five times 10 
or 50; and the two is in the hundreds 
place and stands for two times 100 



or 200. The number then becomes 
two hundred fifty six as it is represented 
in the decimal or base 10 system. 
In binary code or base 2, the first 
digit on the right stands for one, 
the second stands for two, the third 
for four, the fourth for eight, the 
fifth for sixtean, and so forth, 
so that each succeeding digit to 
the left represents double the amount 
of the last digit. Rather than being 
represented by digits 0 through 9 
as is done in decimal , binary only 
uses 1 for on and 0 for off. 

A binary representation of the 
decimal number 6 would be 1 1 0 where 
the rightmost digit is off meaning 
it is not counted, the second digit 
which stands for two is on and the 
third digit which stands for four 
is on. You can then add the third 
and fourth digit to get the total 
of the number. Another exampl e may 
help. The binary number 1110 
0 111 is the equivalent of the 
deci mal number 231 . To convert i t , 
start with the right most digit and 
add one because it is "on". The 
second digit to the right represents 
2 which is added to the 1. The third 
digit represents four which is added. 
The fourth digit represents 8 but 
it is not added since it is 0 or 
"off". While this seems a cumbersome 
system to utilize, it actually uses 
fewer digits to represent large numbers 
than the decimal system to which 
we are accustomed and it places numbers 
in a form the computer readily under- 
stands. Although any number of digits 
can be utilized in the binary system, 
Computers are usually organized around 
multiples of eight digits. Each 
digit is called a "bit" and a set 
number of bi ts , often eight, makes 
up one number which is called a byte. 
Everything inputted to the computer 
is done so in binary form often util i zing 
ei ght bi t bytes . Therefore , every 
key on the keyboard (which is similar 
to a standard typewri ter keyboard) 
i s represented in the computer by 
a byte, which is most often an eight 
bit binary number. There is a standard 
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number system conversion named American 
Standard Code for Information Exchange, 
or ASCII for short, which provides 
the same internal numbering system 
representation of the keyboard for 
microcomputers utilizing this code 
and makes it possible for them to 
tal k to one another. Therefore, in 
ASCI I code whi ch mcst microcomputers 
utilize, when you type a lowercase 
letter "a", that letter is converted 
to the number 97 and enters the computer 
in the binary code 01100001 which 
stands for "a" and i s one byte. As 
you can see, it does not take long 
to stack up quite a few l's and 0's 
in the computer memory. However, 
most microcomputers have at least 
48 ,000 bytes of wor ki ng memory and 
can handle lots of l's and 0's, or 
bits. 

What, you may ask, does the computer 
do with all those bytes? Basically, 
it stores them in it's memory or manipu- 
lates them in it's registers. Imagine 
a postman standing in front of a hugh 
group of pigeonhole boxes numbered 
one at the top left to 1024 at the 
bottom right. As a byte or character 
comes to the postman, he places it 
in the topmost available pigeonhole 
and he remembers both what is in each 
hole and what the address is of each 
hole. After receiving all his data, 
instructions come to the postman to 
do things with the bytes stored at 
certain addresses. For example, he 
may be instructed to double the number 
in hale 200, add it to the number 
in 215 and store the result in 1021. 
That is exactly what a computer does. 
As you can see, the more pigeonholes 
available results in more which can 
be stored. 1024 of these bytes makes 
up a Kilobyte or K for short and the 
more K's of working memory available 
provides increasing capacity to store 
and process information. Microcomputers 
often come wi th at 1 east 48 or 64 
K storage and can often be expanded 
to 640 K or more. As software programs 
become more sophisticated, they require 
increasing amounts of memory so that 
often i n t hi s case , more is better. 



Computer memory is of two types, 
Random Access Memory (RAM) or Read 
Only Memory (ROM). RAM is memory 
which is 1 ost each time the machine 
i s turned off and to which the user 
can read or write. ROM is memory 
which can only be read by the user 
and whi ch usual ly remains in the 
machi ne after it is turned off. 
RAM is often the memory for the user 
while Rom is often the memory utilized 
by the machi ne to make a program 
run. Now that you understand the 
workings of a computer, it might 
be helpful' to know the hardware. 

Hardware 

All the storage memory, addresses, 
bits and bytes, registers, and other 
assorted things mentioned so far 
occur in the center of the computer 
known as the Central Processing Unit 
(CPU) which is where the action occurs. 
In order for information to get around 
in the computer it must be input 
wi th some devi ce and it eventual ly 
is output to some device for the 
user to make sense out of the manipu- 
lations. During this process, the 
bytes travel along a common route 
which connects all the various parts 
known as the BUS. Theoretically, 
the fastest the information can move 
through the computer is the speed 
of light however, it moves much slower 
in actuality due to the resistance 
of the materials used in the circuits 
which causes some heat build up in 
the computer. 

The most common way to input 
information is the use of a keyboard 
which can range from a standard 
typewri ter-1 i ke keyboard to a 1 arge 
board f il 1 ed with special function 
keys. Input can be accomplished 
by any device or means which can 
convert energy to numbers. Therefore, 
common devices include joysticks, 
bar code readers , 1 ight pens , touch 
tablets, digitizing cameras, switches, 
scanners , eye track i ng mechani sms, 
ai r puff recorders , and even sensors 
whi ch read brai n waves . Since the 
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introduction of IBM 1 s Macintosh, a 
device called a mouse has become popular. 
It utilizes a light or mechanical 
ball which can be moved on a surface 
and control a corresponding cursor 
on the computer monitor. With an 
ingenious placing of menus on pull 
down windows on the screen, the mouse 
can be a quick method to indicate 
instructions and it probably is at 
i ts best as a penci 1 control to do 
computer graphics. Computers can 
alsc be activated through voice recog- 
nition; however this technology is 
in it's infancy, and we are likely 
to encounter a great many other methods 
of inputting data in the next few 
years, particularly novel methods 
which can be used by the di sabl ed 
and those of us rusty in our typing 
ski 1 1 s. 

To output from the CPU, the computer 
sends it's binary output electrical 
si gnal s , which can be read by another 
computer through the use of a modem, 
that is most commonly displayed on 
a monitor or printer. Monitors differ 
from a regular television in that 
they contain many more dots of light, 
or pixels and give much better resolu- 
tion. For working frequently with 
numbers and letters, it is recommended 
that a monochrome monitor, usually 
available in phosphorus green or amber, 
be utilized while a color monitor 
is must used with graphic displays. 
The other most common output is to 
a printer. Of the printers , three 
types have become most popular. The 
dot matrix printer contains an impact 
device behind a ribbon which has a 
number of dots which can be impacted 
on the paper to form characters. 
The results look like the printing 
on a cash register tape and while 
legible, are not considered letter 
qual i ty . Dot matri x pri nters offer 
the advantages of speed (measured 
i n characters per second CPS) , the 
ability to do graphics, and low cost. 
Another type of impact printer utilizes 
the typing letters on a wheel resembling 
a daisy and provide a letter quality 
print. These are often used in office 



settings and offer the advantage 
of appearance but cost more and are 
slower. Lastly, the ink jet printers 
have gai ned in popul ari ty as their 
price has dropped due to their advantage 
in quality of print and speed. Other 
possibilities are : 1 aser pri nters 
which use a laser to print on a drum 
and produce and entire page at a 
time in a process similar to a copying 
machine but have been expensive; 
a printer using heat sensitive paper 
whi ch i s cheap but produces i nf eri or 
results; a plotter which can produce 
graphi cs in col or; and combinations 
and expansions of the above. 

Two other forms of output popular 
parti cularly in bl ind rehabil itation 
are braille tape and speech synthesizers 
which do a remar kabl y good job of 
speaking the output. If you are 
purchasing any of these input or 
output devices, keep in mind that 
they need to have a way to interface 
or hook up with the CPU. Many micro- 
computers require the additional 
purchase of an interface card in 
the $50 - $2000 range in order to 
make the i nput/output or peri pheral 
devices work. 

At this poi nt , you understand 
how a computer works in it's CPU , 
and how to get information into and 
out of it's working memory. It would 
however, get old to have to start 
over with every program you wanted 
to work on after each time you turned 
the machine off and cleared the memory. 
For the purpose of saving data or 
storing it on a more permanent basis, 
a disk is used. There are several 
types of disks with the most popular 
being floppy disk in the 5 1/4 inch 
size . A fl oppy disk is a circular 
iron coated plastic disk inside a 
square plastic protective sleeve. 
It is used like a record in that 
it is inserted in a disk drive which 
has a hub in the center whi ch turns 
the disk and a read/write head which 
reads the disk much like a record 
player tone arm. To use a floppy 
disk, you slip it in the drive with 
the label on the top and to the back, 
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close the door to the drive and turn 
on, or reset the computer which will 
cause the disk to be started and read 
(called booted). In looking at the 
disk, you can notice a shiny oblong 
slot in the jacket which exposes the 
inner disk. That is the area read 
by the read/write head and should 
not be touched as the slightest bit 
of oil from your hands or smal 1 est 
particles of debris such as a cigarette 
ash which can interfere or clog up 
the read/write head. While the workings 
of a disk is similar in appearance 
to a record, it is most like a magnetic 
tape which is exactly how information 
is stored and retrieved. Thus, you 
can write on a disk and erase a disk 
just the same as you do an audio tape. 
Also like an audio tape, a floppy 
disk has a notch cut into the right 
side at the tip which allows you to 
write on the disk. If you do not 
want the disk written on as may be 
the case in a program disk, you simply 
cover the notch and the disk can sub- 
sequently only be read. Disks vary 
in price and qual ity and in the available 
usage of a single side or both sides 
and in the density. Therefore, you 
need to know before buying a disk 
which kind your machine requires. 

In addition to the 5 1/4 inch 
floppy disk, you can buy disk drives 
for an 8 inch disk which holds more 
information and the newer 3 1/2 inch 
disk which surprisingly holds as much 
as the 5 1/4 inch. They all work 
the same however. Your computer will 
require that you prepare the disk 
before use. In the operation, a disk 
is divided into sectors of information. 
The computer reads concentric circles 
or tracks of data from the disk and 
it additionally will sector the tracks 
into pie shaped sectors of a fixed 
number of bytes each . Si nee each 
machi ne sectors di f ferentl y , di sks 
pre pared for one brand of machine 
will not run on another brand unless 
it is made to be compatible. 

When purchasing a disk drive, 
it is advantageous to utilize a disk 
which will hold as much information 



as possible. Therefore, a double 
sided disk or one which compacts 
the sectors to hold more bytes is 
preferred. It is also desirable 
to have two disk drives as a number 
of programs require two or make it 
more convenient to use two. It is 
difficult in this area to make definitive 
statements however, as this technology 
is improvi ng weekly. Once you use 
floppy drives for a short time, you 
become aware of their major disadvantage. 
That is, if you have a large program 
to be read into RAM, it takes a few 
minutes and you quickly become tired 
of waiting on the machine and/or 
of filling floppies. One solution 
to those problems is to purchase 
a hard disk drive. They work in 
the same manner as the floppy disk 
except the disk is rigid all owing 
it to ho Id much more i nformati on , 
on the order of 10 to 100 million 
bytes as opposed to 100 to 400,000 
on the floppy, and reading and writing 
is instantaneous. Generally, they 
are enclosed in the machine which 
makes it less likely to have your 
data destroyed, however the drive 
unit is more expensive than a floppy 
drive unit. This concludes the usual 
types of hardware which may be desired 
and leads us to an examination of 
the software which contains the operating 
system, languages, and commercial 
programs. 

Software 

In order to have the CPU know 
how to accept , keep up, and output 
data, it needs instructions. While 
this can and is partially or wholly 
placed in ROM, some part of those 
instructions or all of them are contained 
in an operating system which is programmed 
for a particular machine and usually 
comes on a floppy disk. These instruc- 
tions are know as the Disk Operating 
System or DOS and usually are included 
with the cost of purchasing a machine. 
However, they are updated frequently 
to add different commands or expand 
the range of what your machine can 
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do and you are expected to keep up 
and purchase the updates if you desire 
them. Also, on some machines several 
companies make different special purpose 
operating systems or you will find 
that some other DOS than the one you 
were supplied with has gained in popu- 
larity. Regardless, your first task 
as a new user will be to learn the 
operating system with which you are 
working. Commercial programs are 
written more for an operating system 
than for a particular brand of machine 
so that even those will require you 
to be familiar with your DOSo Once 
you have gained that familiarity, 
you should be able to issues commands 
to your computer which will make it 
perform it's functions. As you might 
expect, operating systems differ among 
di fferent brands of microcomputers 
which will prevent you from using 
one piece of software on different 
machines unless they use the same 
DOS. One type of DOS called CP/M 
has tried to become universal and 
has met with some success but still 
is not a universal system. 

Most individuals are interested 
in using a microcomputer and are less 
interested in programming one as pro- 
gramming takes a great deal of skill 
and time. To use a computer requires 
only that you understand your computer's 
DOS and purchase i .e . , al ready programmed, 
program on a compatible disk which 
you can quickly learn to use. For 
example, for any microcomputer you 
can purchase word processing or financial 
management or data management programs 
which you can learn to operate. These 
range in complexity and cost and are 
regularly reviewed in popular computer 
magazines. It is easy and fun to 
keep up with various types of programs 
and many people enjoy being the first 
kid in their block to obtain a copy 
cf the hottest, newest thing, 

If you are not pleased with the 
commercially available programs for 
your purpose, or if you find the urge 
to sit in front of a monitor for endless 
hours is irresistible, then you may 
want to explore the next level of 
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computer usage through programming. 
With programming, you write the code 
to make the computer do what you 
want - the glory of ultimate control. 
While you might discover that you 
can do a better job of designing 
a program for your needs , prepare 
yoursel f to spend a great deal of 
time. One of the rewards of such 
an effort however is to make something 
whi ch works and in some cases to 
sell something which you have created. 
Programming requires the understanding 
of a computer language which can 
be learned in sel f- instructional 
books or in continuing education 
or uni versi ty courses . Languages 
range from those which are cl osest 
to the binary computer tal k called 
low level, such as machine or assemble 
language to languages which, are most 
similar to english (high level) such 
as basic. The low level languages 
often provide much greater speed 
of operation and can be more complex 
to learn while the h igh level languages 
are simpler to sta? „ out on but slower. 
Most people start with Basic and 
may move on to more complex languages 
if they li 1 '? programming. Other 
popular lar. .ages include Fortran, 
Cobal , APL , Forth , and C. Some 
of these are special purpose and 
are more applicable to different 
situations. It is not unusual for 
a novice to be unsure of what a computer 
can do to be of assistance to them 
and at times it appears that it might 
be faster and easier to do things 
by hand than to invest in a computer. 
If checkbook balancing and reci pe 
storage are the onl y requi rements 
of a user, then a computer does not 
ma ke sense , however there are some 
thi ng. the computer does better , 
parti cul arly if they are operations 
that are often repeated. 

What Computers Do Well 

Mi cro computers can be used for 
many purposes however , they do the 
following five things extremely well : 
1) They can store Mgh amounts of 
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information; 2) They can quickly search 
and retrieve stored information; 3) 
They compare information quickly; 
4) They manipulate graphic symbols; 
and , 5) They rapidly perform mathematical 
functions. For human service workers, 
the ability of computers to deal with 
information in the first three areas 
have proven valuable. For example, 
many office workers deal with words, 
files, and information which are tailor 
made to be computerized to make dealing 
with those faster and simpler. In 
vocational rehabilitation for example, 
it is fascinating to be able to compare 
a worker's aptitude and ability profile 
with every other job in the Dictionary 
of Occupational Titles in a matter 
of a few minutes. Such a process 
done by hand used to take days. It 
is equally intriguing to be able to 
move paragraphs within a typed document 
around in seconds or make editorial 
changes and have documents retyped 
in minutes instead of hours. For 
you to discover what a computer can 
do for you, it is recommended that 
you get one and get started. You 
will find more and more reasons to 
justify it after you begin. 
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COMPUTER SOFTWARE FOR ASSESSING AND 
SHAPING MOTOR PERFORMANCE IN VOCATIONAL 
EVALUATION AND ADJUSTMENT PROGRAMS 
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ABSTRACT: This paper presentation 
demonstrated the Research and Training 
Center 1 s "Learning Curve Analyzer" 
software developed by Dr. Thomas Blakemore 
and Dr. Charles C. Coker. The software 
has been used in research and in clinical 
settings, and continues to be refined 
through research and development. 



Introduction 

One of the processes in Vocational 
Evaluation is the administration 
of work samples to assess the ability 
of an individual to perform a specific 
task or similar tasks. Work samples 
normally represent the actual tasks 
that the individual is expected to 
do on the job. Interpretation of 
performance woul d appear to be a 
simple yes-no dichotomous decision, 
based on the face validity of the 
work sampl e and comparison of task 
performance to an appropriate norm. 
There are three potential fundamental 
errors in drawing conclusions from 
this simple comparison to normative 
criteria . 

First, the norms (industrial 
standards , method-time-motions (MTM) 
measures, or locally developed client 
norms) to which the client's performance 
measures are compared are based on 
individuals whose amount of prior 
training or experience on the task(s) 
typically far exceeds that of the 
client. The usual result is an under- 
estimation of the skill level of 
tlie client. Industrial and MTM measures 
are norms for practiced workers or 
the well -practiced motions of practiced 
workers , while cl ient norms yiel d 
performance norms based on individuals 

amount of practice 
motions. The most 
of thi s cri ti ci sm 
what the normative 
criteria should be, but how to measure 
the amount of prior training or practice 
the client has had, so that practiced 
performance levels are compared to 
similar practiced performance levels. 
It has been shown by Dunn (1976) , 
Chyatee (1976), and Blakemore and 
Coker (1982) that traditional work 
sampl e admini strati on procedures 
involving industrial standards or 
MTM will seriously underestimate 
a cl ient 1 s abil ity. Cl ient norms 
may vary in terms of over- or under- 
estimation of the client's ability. 

Secondly, traditional work sample 
administration loses val uable data 



w*i th an unknown 
on the task or 
-important poi nt 
is not so much 
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that could better determine the client's 
real potential. Clients with the 
same performance level on a work sample 
may not have the same potential. 
One client may have started out slow, 
but steadily acquired higher skill 
levels over repetition of the tasks 
in the work sample. Another may have 
performed at a steady pace over all 
repetitions. Obviously, the problem 
is to determine if learning has been 
completed or not, and whether any 
significant increases in performance 
could be expected. Traditional work 
sample administration fails to examine 
perf orrna nca on each repeti ti on of 
the tasks within a work sample. 

Third, work samples may not be 
used just to measure current functional 
ability, but also as predictive measures 
of an individual's future potential. 
Work sample theory does not include 
valid criteria for prediction of future 
skill level performance. Instead, 
work samples are just that, and the 
appropriate conclusion is whether 
the individual can now perform those 
tasks assessed. When used in a predictive 
mode, work samples become psychometric 
measures and are subject to some questions 
of reliability and validity as those 
measures which they were once taunted 
to replace. 

There is a technique which - Jdresses 
the three fundamental errors of tra- 
ditional work sample assessment. 
This technique involves the measurement 
of performance changes over several 
repeated trials on a task and uses 
statistical measures to predict the 
"learning curve" of the individual. 
Recommendations would be more concerned 
with how long it would take to reach 
criteria, rather than judging the 
presence of absence of the skill. 
The use of learning curve analysis 
could be a valuable tool in the vocational 
evaluator's repertoire. 

Such a recommendation is not 
new and has long been advocated (Tillman, 
1971; Dunn, 1976; and Blakemore and 
Coker, 1982.) , but very few have utilized 
learning curves o estimate whether 
the measured performance is nearer 



to the tip or bottom of their learning 
curve. The application of learning 
curve techniques has not grown simply 
because they have been too time consumi ng 
and cumbersome to apply. With the 
recent availability of low cost, 
yet high powered microcomputers, 
the techniques of learning curve 
analvsis could be used rather easily 
in Vo:ational Evaluation and Adjustment 
programs, at least for repetitive 
motor tasks. 

It is for these fundamental 
errors of traditional work sample 
administration that the Microcomputer 
software was devel oped. The program 
does a number of things, such as 
gather data, store data, compute 
learning curves, present simple and 
complex feedback and pacing stimuli, 
and provide a hard copy of the performance 
i nf ormation and task conditions . 
The primary function, however, is 
to give evaluators and adjustment 
speci al ists with a tool to increase 
their effect iveness in assess ing 
and changing task performance. One 
of the most prominent aspects of 
vocational eval uaiion i s the admini- 
stration of work samples. After 
a client has been assessed using 
work samples, their performance is 
compared to some norm to determine 
how well they performed a task relative 
to other i ndi vi dual s . There is a 
widespread bel ief among many vocational 
eval uators and consumers of these 
services that competitive norms or 
industrial norms are the best basis 
for judging client performance on 
a work sample (Larsen & Curtin, 1973). 
In fact, the Commission on Accreditation 
of Rehabil itation Facil ities regul ations 
state that ". . . if work samples 
are used, competitive norms or industrial 
standards shall be established and 
used." (C;.9F, 1982). There are 
three ways in which competitive norms 
can be establ i shed: (1 ) by using 
the performance of a group of workers 
employed in a particular occupation; 

(2) by using a predetermined motion-time 
system, such as MTM or MODAPTS; or 

(3) by using piece rates established 



ERLC 



by a time-study, if the work sample 
is taken directly from an industrial 
setting. With all of these methods 
of calculating norms, the individuals 
upon whom the norms are based tend 
to have experience and considerable 
practice with the tasks included in 
the work sample. The workers whose 
performance is used to establish competi- 
tive norms and those represented in 
time studies have obviously had experience 
performing the task. Similarly, the 
workers upon whom predetermined motion- time 
studies are computed are also experienced 
at the task (Schwab, 1963). Another 
normative criterion is the development 
of local client norms. In this case 
the amount of previous experience 
on the task is unknown. 

There are a large number of studies 
demonstrating that performance on 
work tasks involving mjtor skills 
shows marked improvement with practice 
(e.g., Fitts & Posner, 1967; Schmidt, 
1975). In addition, further research 
demonstrates that improvement continues 
to occur for many thousands (Cochran, 
1968) and, in some cases, even millions 
(Crossman, 1959) of practice trials. 
The basic conclusion to be reached 
from studies of motor and industrial 
work skills, is that these generally 
show progress ive improvement with 
practice over a large number of trials 
and, perhaps, many years (Peterson, 
1975). 

These findings cast doubt upon 
the validity of competitive norms 
and industrial standards with simulated 
work tasks. Competitive norms (such 
as those derived from a group of employed 
workers in an occupation) and industrial 
standards (such as those derived from 
a pre-determi ned motion-time study 
system such as MTM) reflect the performance 
of experienced workers: those who 
have had Vocational Evaluation programs, 
however , tend to be i nexperi enced 
workers: they have had only limited 
work hi stories and are unempl oyed 
at the time they are receiving services 
(Dunn, 1975). Comparing the performance 
of an inexperienced persons to norms 
and standards developed from the perfor- 



mance of ex pen enced persons tends 
to underestimate the functi oning 
level of the inexperienced person 
(i.e., that level at which the inex- 
perienced person would perform if 
provided with practice equivalent 
to that pobsessed by the experienced 
person) . In other words , when competitive 
norms and industrial standards are 
used with work tcisk time scores, 
and provision is n >t made for the 
individuals to have practice equivalent 
to that enjoyed by the norm or stan- 
dardization group, the result 'is 
underestimation of the cl ient f s potential 
performance level. If this underesti- 
mation occurs early in the Vocational 
Evaluation process, the result would 
be to exclude broad occupational 
areas from further consideration 
for the client. Error later in the 
process would tend to exclude specific 
occupational areas and/or jobs. 

The ability of people (both 
disabled and nondisabled) to reach 
an industrial standard criterion 
within a single administration of 
a simulated task appears to be quite 
1 imi ted . Research by Dunn (1976 ) 
suggests that the abil ity of nondisabled 
persons to reach the 100% of standard 
level in a single a dm i n i s t r at i o n 
of a work sample appears to be similarly 
limited. In this study, normative 
criteria were applied to the work 
sample pe r forma nee of 54 col 1 ege 
undergraduates and found that only 
15% of the males ^ 4 6% of the females 
reached the industrial standard during 
the first administration (50 trials). 
When provi ded wi th an addi tional 
three admini strati ons (150 trials) 
or practice , however , 55% of the 
males and 42% of the femal es met 
the industri al standard . Individ- 
ual i zed predi ction equations , based 
on the times for the four administrations , 
were developed and used to predict 
practiced ("peak" ) level s of performance 
for these subjects. Those predictions 
indicated that, after 20 administrations 
of the work sample, 70% of the males 
would have attained the industrial 
standard, while 70% of the females 
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would have attained the standard after 
25 administrations. In other tfords, 
these data suggest that about 20 admini- 
strations for males and 25 administrations 
for females would be required to clearly 
di f fere nti ate those i ndi vi dual s who 
could readily attain the industrial 
standard from those who could not. 
Thus, in the traditional approach 
to Vocational Evaluation utilizing 
one administration, 55% of the males 
and 71% of the females would have 
been misclassified in Dunn's study. 

Research conducted at Emory University 
Research and Training Center (Chyatte 
1976) provided a client time score 
distribution and industrial standards 
based on MTM-3 for two JEVS work samples; 
union clients who took the union assembly 
and 1.2% of those who took hardware 
assembly reached 100% of the industrial 
standard with one administration of 
the work sample. Results of research 
by Blakemore and Coker (1982) were 
similar to those found by Chyatte. 
On the first administration of the 
Stout- Eye- Hand- Foot Coordination work 
sample only 5% of the clients performed 
well enough to exceed the industrial 
standard for the task. However, after 
four additional administrations of 
the work sample, 55% of the clients 
exceeding the industrial standard 
and individualized prediction equations 
indicated that most of the remaining 
clients could have eventually exceeded 
the industrial norm. 

Learning Curves: A Potential Solution 

A number of researchers (e.g., 
Til 1 man , 1971; Dunn, 1976; Blakemore 
and Coker, 1982) have suggested that 
one way to overcome the problems of 
underestimating client potential on 
work samples is to plot the client's 
performance data in the form of a 
learning curve (or equation) and to 
extrapol ate cl ient potenti al using 
this data. For instance, Tillman 
suggested that the client's performance 
on a task should be graphed with the 
number of practice trials on the horizontal 
axis and some measure of performance, 



such as production rate, on the vertical 
axis. Such graphic representations, 
called learning or performance curves, 
typically show increases in performance 
with increases in practice. The 
law of diminishing returns sets in 
on such tasks, however. That is, 
the slope of the curve, which represents 
the rate of 1 earni ng or improvement , 
is usually very steep on the initial 
practice trials but tends to level 
off as the amount of practice increases. 
Tillman suggested that clients should 
be allowed to practice a work sample 
unti 1 thei r performance curve becomes 
almost horizontal, that is, until 
performance is no longer improving 
and that this level of performance 
would be used to gauge client potential. 
As mentioned above, however, improvement 
can continue for many thousands and 
even mi 1 1 ions of trial s . For this 
reason, Dunn (1976) has suggested 
that Tillman's technique might require 
an exorbitant amount of practice 
before performance levels off. Dunn 
proposed , instead , that the data 
on the performance of a limited number 
of trial s could be fitted to a regression 
(or 1 earni ng curve) equation and 
that this method coul d be used to 
accurately predict client potential. 

The term "learning curve" usually 
refers to a graph representing changes 
i n performance over time or trial s. 
Though the changes in performance 
can be attributed, in part, to learning, 
variations i n the curve al so refl ect 
variabl es other than 1 earni ng which 
affect performance (e.g., environmental 
variabl es , motivation) . Though these 
graphs of performance do not necessarily 
reflect the actual amount of learning 
that occurs, they do refl ect how 
an i ndi vi dual actual ly performs , 
which is the most important aspect. 
Since the term learning curve is 
widely used in literature this study 
referred to the graphing of performance 
(and equations which describe such 
performance) as a learning curve, 
with the realization that such curves 
reflect the effects of many variables. 
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The research by Bl akemore and 
Coker (1982) also indicated that the 
use of the learning curve technique 
does have great potential for providing 
accurate estimates of the level of 
performance that someone can attain 
at a task following practice. Blakemore 
and Coker had Vocational Evaluation 
clients perform on the same work sample 
for five consecutive work days. On 
the average, performance was 30.68% 
better on the final day of practice 
(Day 5) than on the first day of practice 
(Day 1). Thus if the performance 
level (total time score or average 
score } for Day 1 had been used as 
the estimate of the client's capacity 
to perform this task, their potential 
would have been underestimated by 
an average of 30.68%. Blakemore and 
Coker's analysis demonstrated that 
1 earning curves coul d produce significantly 
more accurate predictions on Day 5 
performance. They found that predicting 
Day 5 performance using the total 
performance scores from Days 1-4 produced 
predictions that differed from the 
obtained level of performance by only 
6.78%, on the average. They also 
predicted that Day 5 performance level 
using only the time scores for the 
first 50 Repetitions of the task (Day 
1) and found that these predictions 
differed from the obtained level of 
performance by 17.15%. Both of these 
estimates were significantly better 
than the 30.68% average error made 
when using the total time score for 
Day 1 to estimate Day 5 performance 
level. Thus Blakemore and Coker's 
results clearly indicate that learning 
curves can be used to produce signifi- 
cantly more accurate estimates of 
someone's capacity to perform a task 
than is typically obtained when the 
total time score for a single admini- 
stration of work samples is used to 
estimate that capacity. The findings 
of the study by Dunn (1976) closely 
paral 1 el ed Blakemore and Coker 's findings. 

The advantage of the learning 
curve approach to evaluating work 
sample performance is that this method 
reflects what changes occur in the 
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Examples of differential performance dui ing a work 
sample with tbe same normative score of 67%. 

A. Normal acquisition under an idealized learning curve. 

B. Decline in performance due to fatique or lack of 
mot ivat ion . 

C. Acquisition and reacqulsition due to temporarily 
forgetting tasks, -Hsrupt ion . lack of attention, etc. 

D. Rapid reacquisit Ion to steady state indicating the 
r^learning of a previously mustered task. 

E. Idealized practiced worker performance assumed under 
traditional work .sample administration. 
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client's work sample performance 
during testing, A static process 
of evaluating the level of functioning, 
such as using the mean or total production 
rate, fails to account for differential 
performance during the repetitions 
of the tasks within the work sample 
and the potential for further learning. 
I ndi vi dual s functioning at the same 
average level on a work sample involving 
several repetitions are not necessarily 
perform i ng comparably duri ng the 
entire session. Figure 1 illustrate 0 
this poi nt . In Situation A, the 
ideal ized 1 earning curve is presented 
where skill acquisition increase 
consistently over time. In Situation 
B, performance deteriorates over 
time rather than steady improvement. 
It is clear that the client initially 
performed well , but performance deteri- 
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orated; and may have been caused by 
fatigue, boredom, confusion, etc. 
In Situation C, performance is relatively 
stable except that there is a momentary 
decline in task performance due to 
distraction, forgetting of instruction, 
or perhaps lack of parts. In Situation 
D, there is a rapid requisition of 
the task. It is indicative of having 
had previously mastered the task and 
of the ability to rapidly return to 
that level. Finally, steady level 
task performance from first to last 
repetition is graphed as is assumed 
under traditional work sample admini- 
stration. Only in Situation E is 
the true current and potential level 
of task performance of 67% of the 
normative criterion accurate. In 
the other situations, current and 
potential task performance is under- 
estimated and additional valuable 
information about the client is lost. 
It would not be lost, however, if 
a learning curve analysis was used. 

The Microcomputer Solution to Learning 

Curve Analysis 

The major drawback to the use 
of learning curve is the fact that 
the use of this approach could increase 
the work load of vocational evaluators 
beyond reason. In the traditional 
approach, the total number of pieces, 
the total time to complete a set number 
of pieces, or mean production rate 
are relatively simple to obtain. 
It is also very easy for evaluators 
to administer the work sample and 
obtain the data in such cases, A 
timer is started when the client begins 
the task and is stopped when the client 
is finished. In the interim, the 
evaluator can be busy with other tasks. 

This would not be the case, however, 
if an evaluator were to collect data 
to be used in calculating a learning 
curve for a client. In this case, 
the evaluator would have to constantly 
monitor the client's performance, 
recording the amount of time taken 
to complete each item. Furthermore, 



the evaluator would then have a more 
complex analysis of the data to perform. 
This procedure would, of course, 
reduce the amount of time evaluators 
could spend on other aspects of their 
work or with other cl ients. Thus , 
though analysis of performance through 
generation of learning curves has 
been advocated for a number of years, 
few eval uators consistently employ 
them. 

One of the primary purposes 
of the previous research project 
by Blakemore and Coker (1982) was 
the development of a microprocessing 
(microcomputer) system that automatically 
coll ects data on work sampl e performance 
and calculates a learning curve using 
the data which was collected. That 
device has the advantage for applied 
use of learning curves , i n that it 
can be used to accurately refl ect 
a client's present level of functioning 
and potential . At the same time, 
it does not have the di sadvantage 
of i ncreasi ng the work 1 oad for an 
evaluator. One purpose of this project 
in vol ved determining the feasibil ity 
and uti 1 i ty of making the learning 
curve theo ry a routine procedure 
for evaluating client potential through 
the development and testing of software 
for microcomputers. 

Learning Curve Analysis Software 

The software that was devel oped 
i nvol ved the use of three concepts: 
Learni ng curve analysis , performance 

feedback, and pacing of performance. 
For all three concepts, the recording 
of the time i t ta kes for a cl ient 
to complete each repetition of a 
ta s k on a work sampl e i s requi red . 
The computer provides the timer, 
but the task must include switch 
closure to start and stop the timer. 
The closure can be obtained by including 
pressing a switch as part of the 
task el ements , or an el ement coul d 
start and stop the timer. In the 
1 atter case , a compl eted pi ece coul d 
be dropped i nto a box which cl oses 
the switch or breaks a photocell 
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beam. There are a number of more 
creative and exotic ways that switch 
closure or opening could result in 
control of the timer that is part 
of the software program or computer. 
Once the task is appropriately tied 
to the computer, an evaluator or client 
can utilize the software. 

The accompanyi ng manual expl a ins 
how the user can select and interact 
with the various programs. In Appendix 
A, selections within the Main Menu 
(M), Learning Curve Analyzer Program 
(L), Performance Enhancer Program 
(E), Feedback Menu (F), Pacer Menu 
(P), Data Analysis Program (D), and 
Learning Curve Analysis Menu (C) are 
gi ven . The presentation demonstrated 
the operation of the various sub- routines 
of the software. In addition to these 
relatively well known learning theory 
techniques, the "vest 20% method" 
developed by the' Research and Training 
Center (Blakemore and Coker, 1982) 
and the demonstration of confidence 
intervals or error of measurement 
associated with the learning curves 
were discussed. 

The " Performance Anal yzer and 
Performance Enhancer" software were 
developed as part of the objectives 
of the Research and Training Center 
grant awarded to the Stout Vocational 
Rehabilitation Institute by the National 
Institute of Handicapped Research, 
Officer of Special Education and Reha- 
bilitation, Department of Education. 
Currently, this software is undergoing 
field testing in three different reha- 
bilitation facilities and will be 
made available for use on the Commodore 
64 computer with disk drive upon com- 
pletion. The software may be made 
available for other computers. The 
Commodore , however , does provide a 
relatively sophisti cated computer 
at a reasonable price. The Commdore 
was chosen to increase the likelihood 
of the purchase of a computer dedicated 
to appl ications within the rehabil itation 
services such as Vocational evaluation, 
work adjustment, skill training, and 
job placement. 



APPENDIX A 
Software Program Selections 



PERFORMANCE ANALYZER 
AND 

PERFORMANCE ENHANCER 



Copyrighted Computer Program 

Research and Training Center 
Uni versify of Wisconsin-Stout 



M 



WELCOME TO THE MAIN MENU 



SELECT ONE OF THE FOLLOWING: 

L = LEARNING CURVE ANALYSIS 

E = PERFORMANCE ENHANCEMENT PROGRAM 

D = DATA AlfcL/SIS OF RECORDED DATA 

Q = QUIT 

ENTER THE SYMBOL OF YOUR CHOICE 
AND PRESS RETURN 



WELCOME TO THE LEARNING CURVE 
ANALYZER PROGRAM 



SELECT ONE OF THE FOLLOWING: 
C = DATA COLLECTION 
D = DATA ANALYSIS 
R = REPORT 

4- = RETURN TO MAIN MENU 

ENTER THE SYMBOL OF YOUR CHOICE 
AND PRESS RETURN 
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**•*»» i ********** in** *»»»»»»»•»••»»»»*»- 

WFLCOME VO THE PERFORMANCE 
ENHANCER PROGRAM 
*********** r*^* ********** ******* **i i****-: 



SELECT ONE OF THE FOLLOWING : 
F = FEEDBACK PROC n AMS 
P r PACER PROG" AMS 
D = DATA ANALYSIS 
R = REPORV 

* = RETURN TO MA IK MENU 

ENTER THE SYMBOL OF YOUR CHOICE 
AND PRESS RETURN 



ft******************************************* 

WELCOME TO THE FEEDBACK MENU 

**************»****B*****************II***** 



SELECT ONE OF THE FOLLOWING : 

1 = BARGRAPH 

2 = LASKETBALL 

3 r HOPPER 

4 = PERCENTAGE OF STANDARD 

Jr = RETURN TO PERFORM. ENHANCER MENU 

ENTER THE SYMBOL OF YOin CHOICE 
AND PRESS RETURN 



D 



»»i»»»»»»»»**»i»a*****i****************i!t>j 

WELCOME TO THE PACER MENU 
»»**»*w»»»»********s*************r-i*r.*«**i 



SELECT ONE OF THE FOLLOWING: 

1 r SHARK CHASE 

2 = CLOCK 

«- = RETURN TO PERFORM. ENHANCER MENU 

ENTER THE SYMBOL OF YOUR CHOICE 
AND PRESS RETURN 
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r***********************n***** *********** 
\ WELCOME TO THE DATA 



L) 



ANALYSIS PROGRAM 
**************************************** 



SELECT ONE OF THE FOLLOWING: 

B = BEST 20% METHOD 

C = LEARNING CURVES 

S = DATA SUMMARY 

Mr = RETURN TO MENU 

ENTER THE SYMBOL OF YOUR CHOICE 
AND TRESS RETURN 



C 



*********** ****IB****»ft*«****« ******* ft* 

WELCOME TO THE LEARNING 

CURVES MENU 
*******i***********i*****************&* 



SELECT ONE OF THE FOLLOWING: 

1 r Y=A«X~B POWER 

2 = Y=A+B«C~X MODIFIED EXPONENTIAL 

3 = Y=B«X/X+A LEARNING CURVF. 

«• = RETURN TO DATA ANALYSIS MENU 

ENTER THE SYMBOL OF YOUR CHOICE 
AND PRESS RETURN 
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NATIONAL SURVEY OF COMPUTER USE IN 
REHABILITATION FACILITIES 



PAUL M. McCRAY 
THOMAS F. BLAKEMORE 



ABSTRACT: The Research and Training 
Center at the University of Wisconsin- 
Stout is one of 27 centers funded 
by the National Institute of Handicapped 
Research to conduct research on training 
related to improving the lives and 
well - bei ng of peopl e wi th handicaps . 
Each of the centers has a unique focus. 
The center at UW-Stout is one of the 
few which addresses issues related 
directly to vocational rehabilitation. 
The primary mission of our center 
is to conduct research and training 
designed to enhance the economic viability 
of rehabilitation facilities as well 
as improve the quality of services 
provided to people served by these 
organizations. This particular research 
project is concerned with both of 
these issues. 



This project investigated a 
number of aspects of computer use 
in rehabilitation facilities. It 
consisted of a two-phase survey of 
approximately 4,000 rehabil itation 
facilities nationwide. The overall 
purpose of this project can be broken 
down into five distinct objectives 
which focused on identifying: (1) 
the current extent of computer use 
in rehabilitation facilities; (2) 
how they are being used in terms 
of admi ni strati on , rehabil itation 
services, and production management; 
(3) what specific types of hardware 
and software configurations have 
been installed; (4) what trends are 
likely to affect the progress of 
computer use in facilities; and, 
(5) the feasibility of developing 
a national network of rehabilitation 
facility computer users. Only the 
results of the first phase of this 
project will be presented here. 

Method 

Sampl e 

The target a.ud i e nee of this 
survey included all facilities which 
offer any (re)habil itation services 
to individuals with handicaps. Surveys 
were sent to 4181 facil ities on the 
Research and Training Centers mailing 
list. The majority of these facilities 
would be considered sheltered workshops. 
Also included in the sample, however, 
were a number of schools, universities, 
and hospi tal s with rehabil itation 
programs. 

The questionnaire was first 
mai 1 ed at the begi nning of August, 
1983 to all 4181 ft cil Ities on our 
mailing list. "*he questionnaire 
consisted of two parts . Part one 
addressed facil ities a 1 ready using 
computers i n thei r operati ons . Part 
two addressed nonusers and was designed 
to assess the extent to which nonusers 
planned to integrate computers into 
their operations in the future. 
There were 962 completed surveys 
in response to the first mail ing 
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and 600 "dead letters 11 returned by 
the post office as undel i verabl e . 
Three months after the initial mailing, 
a second mail ing was sent to al 1 facilities 
for which a completed survey or dead 
1 etter notice had not been recei ved. 
An additional 624 completed surveys 
were received from the second mailing, 
for a total response rate of 1536 
returns. This represent 44% of the 
3581 facil ities which presumably received 
the questionnaire. 

Results and Discussion 

The data consisted primarily 
of frequencies but also included brand 
names and mode Is of computers, the 
purchase costs of computer equipment 
and software, the costs of operating 
computers, the number of clients and 
employees in facilities, and the annual 
operating budgets of those facilities. 
These data were coded and entered 
into a computer for analysis. The 
data analysis consisted of determining 
the frequency of responses to various 
questions and the use of cross tabulations, 
chi-square tests, and analysis of 
variance where appropriate to determine 
whether group differences were signifi- 
cant. The results are briefly discussed 
in the remaining portions of this 
paper. Space 1 imitations prevent 
a thorough discussion of all of the 
results in this presentation, however, 
a final report on this project will 
be issued by the center and will be 
available to interested parties. 

Characteristics of Facilities Which 
Do or Do Not Use Computers 

Of the 1586 facilities which 
responded to the survey, 864 (54%) 
are currently using computers, whereas 
722 (46%) are not using them. Users 
may be timesharing, using a data processing 
bureau, or own or lease a computer(s). 
The percentage of users in this study 
(54%) was quite similar to Miller's 
(1981) findings which indicated that 
51% of the estimated 2403 facilities 
he surveyed wero usi ng computers . 



However, as will be seen later, there 
is a notable difference between these 
two groups in terms of computer ownership. 

The rel evant data were examined 
to determine how Users and Nonusers 
differ. Table 1 Presents a summary. 

TABLE 1 



Summaries of Analyses of Variance Comparing Computer 
Users and Nonusers on Number of Clients Served Annually, 
Number of Employees, and Size of Annual 8udget 



Source 


Group 
Mean 


Mean 

df Squares 


F 


P 


Number of Clients 


Between 

Users 

Nonusers 
Within 


1225 
614 


1 110,641,551 
1205 3,992,838 


27.71 


<.001 


Number of Employees 


Between 

Users 

Nonusers 
Within 


154 
51 


1 3,121,645 
1205 39,397 


79.23 


<.001 


Annual Budget 


Between 

Users 

Nonusers 
Within 


$2,820,495 
$1,096,321 


1 862,109,816 
120S 6,613,013 


133.39 


<.001 



TABLE 2 

Percentages of Users and Nonusers Indicating That 
They Provide Specific Rehabilitation Services and 
the Results of Chi Square Tests Comparing the Groups 



RehabM Ration 


X of 


I of 






Service 


Users 


Nonusers 


Chi Square 


P 


Vocational/Work 










Evaluation 


71 


58 


27.99 


<.001 


Psychological 










Testing 


57 


30 


10.83 


<.001 


Personal/Social 










Adjustment 


72 


57 


40.34 


<.001 


Work Adjustment 










I r a1n1ng 


70 


58 


26.79 


<.001 


Occupational Skill 










Training 


58 


34 


91.53 


<.001 


On-The-Job 










Training 


55 


39 


39.8' 


<.001 


Job-Seeklng-SkJlls 










Training 


64 


49 


34.99 


<.001 


Job Placement 










Services 


63 


47 


45.47 


<.001 


Sheltered 








Employment 


57 


47 


13.89 


<.001 


Work Activities 


63 


54 


13.57 


<.001 


Independent Living 










Training 


56 


43 


30.16 


<.001 


Dally Living SklPs 










Training 


66 


51 


30.16 


<.001 


Recreation 


58 


45 


25.92 


<.001 


Medical Services 


46 


25 


79.92 


<.001 


Residential 


39 


24 


40.84 


<.001 
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It can be readily seen that Users 
generally represent larger facilities. 
A second set of analyses was calculated 
to determine whether Users and Nonusers 
differ in the types of services provided. 
Table 2 presents the percentages of 
each group which provide various services 
and the results of Chi Square (x2) 
tests that were performed on these 
data. As is evident, significantly 
more of the Users provide each of 
the services listed in the table than 
do Nonusers. The results of both 
of these analyses indicate, not sur- 
prisingly, that it is the larger and 
more comprehensive facil ities which 
are currently using computers. 

Analyses of Facilities which Currently 
Use Computers 

Table 3 presents the various 
percentages of how current computer 
users tend to utilize their systems. 
As is quite evident from the table, 
the heaviest use of computers at this 



time is for various administrative 
uses, primarily in the areas of accounting 
(70%) and bookkeeping (64%) and staff 
payroll (61%). The percentage of 
computer users involved in production 
and rehabil itation functions is consider- 
ably 1 ower . The most heavily used 
production categories were: Record- 
keeping/Reporti ng (31%) ; Inventory 
Control (26%); and Cost Control (22%). 
With regard to use in rehabilitation 
services, by far the greatest use 
was in the area of Assessment (2?%], 
which .includes both psychological 
and vocational . 

Types of Computers Used 

Another set of analyses examined 
i nf or ma ti on r el a ted to the types 
of computers facil ities currently 
used. The f i rst of these examined 
the cl ass of computer. The resul ts 
are depicted in Table 4 below. In 
addition, 19% of the facilities which 
use computers stated that they use 



TABLE 3 

Current Computer Use In Administrative, Production* and Rehabil Itation Service '-rut leal torn 



ADMINISTRATIVE 
AppHcat 1on % 



PR00UCTI0N 
Application X 



Accounting 70S* 

Bookkeeping 64X 

Word Processing 50X 

Hailing Lists 53X 

Spreadsheets 38t 
(Business Projections) 

Staff Pa/- ..> ■ 61* 

Client Payrcli 48X 

Program Eva* -fat len 34X 

Other 21X 



Production Control 1 21 

Production Scheduling 10X 

Inventory 26X 

Motion-Time Study 6X 

Usifrac* Bidding 9X 

Cost Control 22X 
Production RecorJs/ReDorts 31 X 

0t>,er 42 



Percentage of current User* employing computers for this application. 
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REHAB illTA MM W .'CES 
Appl Icat ' :u 



Assesimen: 25X 
(Vocatl '.ii !.\ :itat1on, 
Psychol, ■ i Testing, etc.) 

Adjustment 13X 
(Personal, Social, Work) 

ReMdentl b! iox 

Independent Living Training gx 

Job See. Ing Skill Training 16X 

Other llx 
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timesharing and 38% use a service 
bureau arrangement. - Perhaps of most 
notable importance, there appears 
to have been a dramatic increase in 
the number of facilities which own 
computers, particularly microcomputers, 
compared to two-and- one-half years 
ago when Miller (1981) conducted his 
survey. 





Table 4 




Comparison of Computer 
1981 


Use and Ownership 
versus 1983/1984 


In Facilities - 


Type of Use/Ownership 


Miller's 1981 
Find Ings 


Current Findings 
1983/84 


facilities owning computer 
of any type (micros, minis 
m«1n frames) 


31X 


661 


Facilities using Service 
Bureau/Time Share 


58X 


485 


Microcomputer owners 


12X 


47X 



Miller found that only 31% of 
the users owned a computer whereas 
66% of the users in this current study 
own at least one. He also found that 
58% of his users used a service bureau 
or timesharing system while only 48% 
of the users i n t hi s study rel ied 
on such an arrangement. Most importantly, 
only 12% of Miller's users has a micro- 
computer. This is in sharp contrast 
to the present study which found that 
47% of the users have one. It seems 
paradoxical, therefore, that there 
was not a corresponding increase in 
the number of facilities which are 
now using computers (51% in Miller's 
Study versus 54% in this study). 
The lack of an increase may be because 
many facil i ties which were u^ing computers 
have simply acquired additional (micro)- 
computers and the number of users 
has not, therefore, risen. Alternatively, 
there may be some difference in the 
types of facilities which the two 
studies sampled. 

Users were also asked to list 
the brands and models of their computers. 
There were over 90 separate brands 
or models listed among the returns. 
The twenty most frequently cited models 
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and the number of facilities using 
them are listed in Tat**- 5. 



The Brand and Model of computers Most Frequently 
Used In Rehabilitation r'-:C* : illes and the Number of 
Facilities V;1ng lhem 



Computer Brand/ModtM 




of Users 


Apple II 




224 


Radio Shack (all mr."*] 


is) 


138 


IBM Personal Computer 




78 


IBM System 34/33 




67 


IBM 360/370 




52 


AOP 1750 




29 


Digital Equipment POP 


11 


23 


Commodore 64 




21 


Burroughs 




Z'i 


Oatapolnt 




18 


Hewlett Packard . ; uoo 




16 


Tc^as Ins tr i - 




15 


Compaq 




15 


Wang 




14 


Qantel System ?:i 




12 


Televldeo 




11 


Altalr 3200 




11 


Frankl In Ace 




10 


Basic IV 




10 


Vector 3 




9 



Costs of Cotfptter Use and Operation 

Tabi e 6 presents the means for 
hardware and software purchasing 
costs and the annual operating cost 
for each cl ass of computer. There 
are sizeable differences in the costs 
of different classes of computer 
systems. The hardware costs include 
peripheral devices such as printers, 



TABLE 6 

Mean Costs of Hardware, Software, and Annual Operating 
Expenses for Users of Microcomputers , Minicomputers, 
and Main Frame Computers 



Type of Expense 

Class of Computer Hardware Software Annual 0per~ 

Cost Cost atlng Cost 

Microcomputers US, 379 $2,304 $8,683 

Minicomputers $61,02! $11,137 $16,320 

Main Frame $453,283 $106,966 $191,214 



There were 231 microcomputer useri. 66 minicomputer users, and 
IS main frame users Included In these analyses. 
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monitors, modems, etc. The costs 
for annual operating expenses include 
personnel costs. With many mainframe 
and minicomputers, a computer specialist 
would need to be hired to operate 
the system. 

Training Needs of Facilities 

A number of analyses were performed 
to determine the training and software 
needs of current computer users. 
The respondents were asked to rank 
the importance of various computer 
related information needs. The results 
indicated that the highest priority 
for facilities was for customized 
software programs written specifically 
for rehabilitation operations followed 
by a need for short-term training, 
then an introductory handbook, and 
finally, development of a computer 
user's network. A strong need for 
all these resources was indicated 
as evidenced by the fact that 67% 
of all users indicated a need for 
both the handbook and the user network, 
despite the fact that these were ranked 
as the two lowest priorities. With 
regard to the need for short-term 
training, 50% of the respondents indicated 
that the training programs already 
available in their locale were adequate. 
However, 65% of the respondents that 
indicated a need for short-term training 
exp>^sed a willingness to send staff 
to short-term training seminars speci- 
fically focused on computer use in 
rehabilitation facilities. 



Analyses of Facilities Hhich Currently 
Do Not Use Computers 

One of the pri nci pi e questions 
of interest concerning the 722 nonusers 
that responded was whether they planned 
to purchase a computer within the 
next 18 months. This issue was addressed 
in. an effort to gauge the future growth 
that can be expected in this field. 
It was assumed that any facility that 
did not plan to purchase a computer 
within the 18 month timeframe was 



probably not serious about purchasing 
one. 

In response to this question , 
29% stated that they would definitely 
purchase a computer within the next 
18 months; 46% indicated that they 
may purchase one; and 25% stated 
that they definitely would not purchase 
one. The latter group was asked 
why they would not be purchasing 
a computer. A summary of their responses 
is presented in Table 7. Lack of 
f i nanci al resources i s the primary 
reason given by this group for not 
purchasing a computer. 



TABLE 7 



Reasons Why Facilities May Not or W111 Not 
Be Purchasing A Computer Within Next 18 Months 



Reason For Not Purchasing 


X of 
Facilities 


Lack of financial resources 


71X 


Lack of Experienced Personnel 


35X 


Not Convinced of Benefits 


15X 


Insufficient Knowledge of 




Computers 


31X 


Other 


UX 



Summary and Conclusions 



A number of important findings 
have resul ted from this research . 
Foremost among these i s the dramatic 
growth in computer ownership which 
has occurred in the last two years. 
One of the implications of this finding 
is that the future will see an increasing 
trend toward the development of customized 
software for facility applications. 
The need for this type of software 
was listed as the number one priority 
among users. And with more users 
havi ng access to their own systems 
in-house , it is expected that devel opment 
of much' of this software will take 
pi ace within faci 1 i ties themsel ves 
as well as through commercial publishers 
and vendors. 
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Another clear finding of this 
study is that facility personnel have 
a great need for information concerning 
computer use , des pi te the fact that 
there is literally a flood of such 
i nf ormati on currentl y a vai 1 abl e in 
the computer industry. More than 
60% of the users indicated a need 
for training in such areas as computer 
system management and computer applica- 
tions. Indeed, more than 30% of the 
computer users i ndicated a need for 
training in computer selection and 
over half need information on computer 
programming. There is also a need 
for customized software with over 
two-thirds of the current users indicating 
a need for customized administrative 
and production programs. Two-thirds 
of the users also expressed a need 
for an introductory handbook on computer 
use in facilities as well as in forming 
a nationwide facility computer users' 
network for the exchange of information, 
as a direct out growth of this research, 
the Center will soon be issuing a 
national directory of facility computer 
users which will serve as the basis 
for developing this user network. 

Another important finding of 
this research is evidence suggesting 
that computer use in facilities is 
likely to expand in the immediate 
future . Twenty- ni ne percent of the 
current nonusers indicated that they 
would definitely be purchasing a computer 
in the next 18 months. And another 
46% of the nonusers indicated that 
they may purchase a computer within 
the same time frame. With the dramatic 
increase in computer ownership already 
i denti f ied , and the expectation that 
microcomputers will continue to decline 
in cost, the evidence suggests that 
computer use is likely to expand drama- 
tically in facilities in the immediate 
future. With the expansion of this 
market , it is 1 i kely that customized 
software devel opment will become i n- 
creasingly common. 

Finally, it shoul d be noted that 
this paper presents a necessarily 
brief discussion of this project. 
Space 1 imi tati ons do not al 1 ow for 



a complete analysis and discussio 
of all the issues addressed in thi 
research. Several additional concern 
which were included in this stud 
focused on software ratings by users 
what customized software has alread 
been developed in facilities, th 
use of consultants, problems in syste 
development, and several other importan 
issues. A number of important resource 
were also identified through thi 
project and will be 1 i sted in th 
previously menti oned di rectory o 
users. For example, a number o 
commercial vendors which have alread 
de vel oped c us torn i zed software f o 
facil ities were identified. In addition 
a specialized project funded by th 
Rehabilitation Services Admini strati o 
in conjunction with Metro Industrie 
in Louisville, Kentucky was als 
i denti f ied. Thi s three-year projec 
focuses on the development of customize 
software for facility use. Thi 
software will then be made avail abl 
to facilities at a minimal cost 
Al 1 of these i ssues and many othe 
findings from thi s research wi 1 
be addressed in detail in the fina 
project report and the national director 
of facility computer users whic 
are expected to be available fro 
the Center in early 1985. 
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THE USE OF COMPUTERS IN VOCATIONAL 
ASSESSMENT 



ROBERT A. TANGO 



ABSTRACT: The work of vocational assessors 
at Semi no! e Community Coll ege is reviewed. 
Examples of the application of modern 
computer technology to vocational 
assessment are offered with examples 
of computer assisted validity studies, 
scoring procedures, and report writing. 
Plans for future use of computer inter- 
active video technology for work evaluation 
are discussed. 



This paper will focus on thi 
computer-assisted aspects of vocationa' 
assessment. It will outline variou: 
concepts and computer based studies 
which have been done at Seminoli 
Communi ty Coll ege . In some case: 
these studi es have been com pi ete< 
and in others they are still in process 
but they all illustrate the significance 
of computers to vocational assessment' : 
validation, relevance to pub! ic educatioi 
and rehabilitation, and to the contro' 
of the costs associated with assessmem 
activities. 

The work of the "work evaluator 1 
is that of the scientist (Lingoes 
1979). The scientific challenge 
of work evaluation is to objectively 
compare an individual to work demands 
Using a computer can offer an evaluatoi 
logical precision in this effort, 
The precision imposed by the compute) 
requires that the evaluator careful lj 
understand the nature of the date 
which he or she is collecting. Ir 
order to best fit information intc 
a computer, that information shoulc 
be in fundamentally yes/no formats, 
This is because the computer's intricate 
system of logic rests on electronic 
equivalents of yes and no. 
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There are many questions whicl 
can be answered about an evaluee 
by an evaluator in a yes versus nc 
fashion, yet at first glance these 
questions may appear much more compli- 
cated. For example, task analyses 
provide clusters of work ol ement< 
which are put together in work samples, 
A work sample fits into a computer' < 
logic in the form of a question requiring 
a decision; e.g., "Can the evalue* 
successfully perform this work ir 
competitive time?" In order to answet 
this question the computer may b< 
cal 1 ed upon to sum how many times 
an evaluator observed a certain evaluee 
behavior or to keep track of the 
seconds which have elapsed from th* 
time the evaluee stated working, 
By doing the above and possibly other 
logical manipulations of evaluator 
input, the computer can output scores. 



graphs, narratives, and whatever a 
good programmer can engineer. 

What about work samples themselves? 
Can the computer be used to study 
the psychometric quality of work samples? 
In a study done at Seminole Community 
College (SCC) in Florida, evaluators 
break down their observations of eval uees 
into a series of yes and no questions. 
Examples of these questions were: 
Did the evaluee hold the hammer at 
the end of its handle without being 
told? Did the evaluee pick up the 
pieces of tin without dropping them? 
Was the evaluee's time to completion 
faster than 7 seconds? 

This humble beginning has led 
to some startling results. When this 
effort started, SCC's Work Evaluation 
program took three weeks, employed 
5 Full time staff, and required 7,000 
square feet of space. When computers 
were brought to bear on an analysis 
of the efficiency of this effort, 
the procedures were reduced to four 
days, space to 1000 square feet, and 
personnel to two. By using computers 
to analyze evaluator observations 
in the form of yes or no statements, 
a good many of the observations were 
found to be frequently the same for 
almost all of the eval uees encountered. 
These items obviously added little 
to an evaluation report. Based on 
this analysis, observation procedures 
were revised. 

With tighter control on how and 
what was observed, the computer was 
used to study the i nten crrel ations 
among the observations which were 
left. Based on the results of these 
factor studies, the meaning of the 
observations was enriched. In those 
evaluee cases which were tested both 
with the General Aptitude Test Battery 
(GATB) and work samples, a computer 
was used to assess whether GATB scores 
and work samples data were related. 
This study encouraged further use 
of work samples because it was found 
that work sampling was tapping the 
same general performance domains as 
the GATB, yet work samples yielded 
additional in f ormati on about work 



style , test taking attitudes , time 
related endurance, etc. In this 
example, computing the relationship 
between work samples and a well re- 
searched, famous psychometric device 
like t;^ GATB, yielded evidence of 
work Simples 1 concurrent validity 
and provided statistical support 
for the use of work samples. 

Anytime there i s a great deal 
of information to be processed, computers 
are a valuable asset. In the following 
exam pi e from the f i el d of Special 
Education, the dilemma for the evaluator 
is to keep track of how many correct 
and incorrect responses a student 
gi ves to tests given at the end of 
each teaching session; further, this 
teaching technique, known as Precision 
Teaching (Fox, 1982), requires a 
precise counting of how many seconds 
or minutes it takes a student to 
complete the response process. At 
SCC, records for precision teaching 
are kept on a computer. The computer 
uses this basic information to calculate 
the learning rates of each student 
for each lesson the student attempts. 
Other statistics regarding the student 1 s 
improvement and the reliability of 
the student's response pattern are 
calculated. 

Since precision teaching involves 
the devel opment of a database on 
trai n < ng outcomes and very careful 
control of i nterven i ng vari ati ons 
in the lesson plan ard teacher delivery 
format, the records kept by precision 
teaching personnel are currently 
being used in a computer assisted 
study of the predictive val idi ty 
of the Work Eval uati on program at 
SCC . Thi s is being done by means 
of several computer programs which 
relate work sample scores to learning 
curve results. For example, a dexterity 
work sample score is used as a predictor 
variable in a regression equation 
on lessons involving the use of the 
hands (clothing production , dent 
smoothing, etc.). High scores on 
dexter i ty work sampl es shoul d be 
predictive of faster learning rates 
on dexteri ty based 1 earning tasks . 4 



ERLC 



Stated in the form of testable hypotheses, 
SCC is in the process of understanding 
the relationships of work samples 
scores to learning outcomes. Without 
computers this important aspect of 
vocational assessment research would 
be too costly and time consuming within 
the context of publ ic education settings. 

Besides concurrent and predictive 
validity studies, the computer has 
allowed SCC to score work samples 
in ways that would be far too time 
consuming if done with a calculator 
or by hand scoring. Because SCC uses 
a computer to record sample scores, 
the computer is available at the point 
of eval uation. This allows SCC evaluators 
to input behaviors witnessed during 
the evaluee's attempt to get through 
the sample. SCC has developed an 
instrument called a Work Sample Behavior 
Checklist (WSBC) which includes a 
panorama of behaviors witnessed by 
evaluators over ten years of evaluation 
experience. By inputting the behavior's 
code_ number, the evaluator can attach 
a given behavioral description to 
a given work sample score. This easy 
to do computer programming routine 
has added an affective dimension to 
work sampl e scores . The WS3C al 1 ows 
for easier report writing because 
it captures "discrete data" in a standard- 
ized manner. This information in 
conjunction with interview results, 
personality testing, and small group 
work points out key motivational issues 
in the evaluee. 

During the ten years that SCC 
has utilized Work Evaluation with 
vocational and special needs students, 
literally thousands of evaluation 
reports have had to be written. This 
one activity has probably taken more 
time and effort and been subjected 
to more public scrutiny than any other 
aspect of the Work Evaluation process. 

Computers have been used to make 
report writing an easier process which 
yields interesting and useful information 
to the teachers and caseworks who 
read the reports. This has been done 
in two ways: each time a report was 
written, records were kept of the 
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eval uee 1 s diagnosed learning or behavioral 
dilemma. The suggestions made in 
rel ati on to the di 1 emma were al so 
recorded. Coding was used to allow 
computer retri e val of suggesti ons 
in relation to specific dilemmas. 
After at least thirty .cases with 
similar pr obi ems were dia gnosed , 
the computer was used to list the 
suggesti ons gi ven for the sol ution 
of the probl ems . As this process 
developed better and clearer relationships 
to presenting problems, solutions 
were incorporated in a prescribing 
catalog. This catalog is keyed to 
work sample score 1 eve! s by use of 
a programming technique known as 
11 three dimensional array" . This 
procedure offers many of the advantages 
of the prescri bing catal og uti 1 ized 
in the Individual ized Manpower Training 
System in Florida with scores from 
the Tests of Adul t Basic Education 
(CTB/McGraw-Hil 1 , 1967). 

The second way that computers 
have helped in the writing of reports 
is by use of a widely expanding area 
of office practice called Word Pro- 
cessing. Interpretive phrases which 
relate to work sampling scores , observed 
behaviors, and other aspects of a 
work evaluation report are given 
computer code numbers. When writing 
a report, the report writer can save 
a great deal of typing time by simply 
listing the computer codes which 
rel ate to the eval uee 1 s performance . 
The report writer types in the unique 
aspects of the evaluee's report and 
then the computer cennects and prints 
out the general coded sections of 
the report. These two report writing 
computer assists have been most helpful 
in getting reports out in time and 
with less effort. 

A new vista for vocational assessment 
and computers is in the area of computer 
interactive video. SCC is in the 
initial phases of making its sample 
system one which is not only computer 
interactive, but also one which allows 
the evaluator and/or evaluee to "travel" 
through the sample system based on 
his or her successes or failures. 
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The journey wi 1 1 start wi th the eval uator 
and/or evaluee inputting the case 
features which are unique to the evaluee 
(name, address, presenting problem, 
questions to be answered in evaluation, 
etc.)* The evaluee will start with 
a broad sample challenge which is 
designed like a preliminary talent 
assessment. Based on the evaluee's 
experience on this locator challenge 
and on the probability tables in the 
computer's memory, the computer will 
assign the next sample challenge. 
This process continues until the evaluee 
exhausts the samples which he can 
and wants to do. The computer will 
then go to the report writing mode 
outlined above. 

The journey through samples will 
involve a process similar to The Singer 
Company (1979) in which pictures, 
sound, and tactile stimulation will 
help the evaluee understand what to 
do. The difference will be that instead 
of sound/slide, the computer will 
call up video segments of instructions 
from an interactive video disk. This 
will bring together the communication 
power of television with the wide 
spectrum of tal ent assessment capabil ities 
of vocational assessment. 

In summary, computers and vocational 
assessment are logical partners in 
testing and curriculum planning for 
special needs and vocational students. 
Computer based simulations have revo- 
lutionized training and testing in 
the military and industry, and now 
they are changing education and rehabili- 
tation. There is little doubt that 
computers and vocational assessment 
have changed the dominance of verbal 
and written testing for special needs 
populations, and that the future will 
open up new and better ways to understand 
special students and their unique 
training needs. 



Fox, S. (1982). Has precision teaching 
made an impact in the field of 
education? J ournal of Precision 
Teaching . 3-2, 34-38. 

Lingoes, S. (1979). Geometric Repre- 
sentation Multidimensional Data. 
Ann Arbor, MI: Mathesis Press. 

The Singer Company (1979). Vocational 
Evaluation System. Rochester, 
NY: The Singer Company. 

Authors 

Robert A. Tango 
Vocational Assessment Center 
Seminole* Community College 
Stanford, FL 



REFERENCES 

CTB/McGraw-Hil 1 (1967 ) . The Tests 
of Adult Basic Education. Monterey, 
CA: CTB/McGraw-Hil 1 . 

165 



178 



EMPLOYMENT THROUGH REHABILITATION 
TECHNOLOGY AWARENESS : A mTIDISCIPLINAM 
APPROACH 



WM. F. JOHNSON 



ABSTRACT: Rehabil i tat ion engineering 
efforts have resulted in many new 
devises that can be used by persons 
with disabilities. This explores 
the ways that these technological 
products can be used by and for handicapped 
youth. 



As a natural outcome of any 
sustained engineering effort, rehabil- 
itation engineering has resulted 
in a large offering of new technology 
for the needs of the disabled. In 
addition to the products of special 
"ehabil itat iun engineering centers 
funded national ly by the national 
Institute for Handicapped Research, 
there also ex i stj on the market ? 
wide range of commercial products. 
One need only visit the exhibit section 
of any national conference deal ing 
with technology and the disabled 
to di scover the expanse of thi s commercial 
industry and also sense its growth. 
For professionals in the field this 
means an ever increasing variety 
of aids and devices to overcome the 
handicappi ng conditions in almost 
any physical environment. This paper 
is concerned with the promise chose 
technoloqies hold as a possible starting 
point for linking various professionals 
to meet the needs of handicapped 
youth. in this paper, it is also 
recognized that most barriers to 
successful vocational preparation 
of handicapped youth are not 0 jst 
barri ers in the phys i cal sense . 
It is hoped that special educators, 
vocational educators, vocational 
rehabil itators , and potential employers 
will be able to apply new technologies 
i n simple , efficient ways to remove 
design barriers in learning and working 
envi ronments . These professional s 
may have a common interest in technology 
because of their technical and industrial 
bac kgrounds . By so 1 vi ng probl ems 
through technology, it is hoped that 
mul tidiscipl inary teams can go on 
to solve more intricate and less 
tangi bl e i ssues deal i ng wi th empl oy- 
ability, issues such as behaviors 
and attitudes. After all , employabil ity 
is the one key factor needed to link 
a transition frorc school to work. 

Just as a work site or job station 
in industry is modified to allow 
use by a disabled individual so must 
1 earning si tes or envi ronments be 
modified to meet special needs . 
As training in industry (sheltered 
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or competitive) is modified to accommodate 
i nd i vi dual di sabi 1 i ti es . Teach i ng 
methods and curricula must also be 
modified to alleviate the effects 
of a disability and allow learning 
to take place. Once learning obstacles 
are removed from the instruction design 
or setting, the disabled student is 
like any other student. 

Modification aware educators 
and employers are confronted with 
an enormous diversity of aids, devices, 
and techniques used to accommodate 
different disability types. It might 
be good for colleges and universities 
who prepare educators in vocational 
and industrial education to require 
undergraduates to take a course in 
the nature of disabilities. This 
may help overcome a new teacher's 
shock when confronted with a disabled 
student in their classroom. However, 
there may be a simpler approach that, 
for the present, offers a basic analysis 
of disability types and the various 
technologies which are most effective 
with them. A three way breakdown 
of disability types is illustrated 
in Figure 1. When considering this 
illustration, the observer must be 
cautious. First, most disabled individ- 
uals do not fit neatly into one of 
three categories. For instance, a 
mentally retarded individual may have 
a cardiac condition limiting strength 
and, as well, a visual impairment 
Second, this illustration places instruc- 
tional and behavioral techniques on 
a plane with "hard" technologies. 
With these cautions in mind, one can 
proceed to use the concept to its 
best effect. That is, to find where 
technology interfaces with the effects 
of any di sabi 1 ity. 

Returning to the example presented 
a mentally retarded individual with 
cardi ac and vi sual impa irments , and 
educator or potential employer will 
c ee how the various technologies impact 
on the individuals needs. A component 
solution in formed using an optical 
solution to the visual barriers, a 
mechanical assist to overcome the 
physical barriers, and a specialized 
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teaching/training technique for the 
menta 1 impa i rment . The compos i te 
sol ution, upon appl ication , promotes 
access to 1 earni ng or em pi oyment . 
This basic understanding of the effects 
of disabilities and knowledge of 
the search orocedures for answers 
provides a starting point and a link 
for all professionals involved. 

A mul t i di sci pi inary approach 
is the foundation of any successful 
school to work program. The demands 
that educators and employers understand 
the efforts of each other and realize 
the benefits to business and community. 
Employers are most 1 ikely to support 
and involve themsel ves in education 
programs that they see as providi ng 
a sel ection of personnel with appropriate 
work behaviors and skills related 
to their operations . Empl oyers will 
also find that these kinds of programs 
are made up of teams in the educational 
sector. Teams made up of vocational , 
industrial , technical , and special 
educators with ties to vocational 
rehabilitation and other involved 
professionals are the only answer 
to solving the melee of problems 
encountered when ha ndi capped youth 
move through the main stream of the 
system. 
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Before technology or other methods 
can be ef f ecti ve , student characteri sti cs 
and instructor time must be considered. 
Teachers are confronted with problems 
involving behaviors and one-on-one 
instructional time from mainstreamed 
special education students in their 
classrooms. In our exploration of 
technology and use of special methods 
teachers complaints in these areas 
cannot be ignored. Successful programs 
facing the demands made by PL94-142 
gather knowledge of the content and 
goals contained in the IEP for each 
student and knowledge of how behavior 
change programs arc monitored and 
carried out for each student. Every 
educator involved must know and be 
a part of the total program. 

Mai nstreami ng represents not 
only a dramatic change for students 
but for educators as wel 1 . They experience 
a major shift in attitude and respons- 
ibility. Hippolitus (1980) states 
"a widespread belief by education 
programs, including special education 
programs, that it's somebody else's 
job to get disabled young people ready 
for work. Generally it is felt that 
the state- federal vocational rehabilitation 
program is the agency responsible 
for this effort. When we realize 
that approximately 650,000 handicapped 
young people leave out nation 1 s education 
system through graduation or termination 
of eligibility each year, we being 
to realize that the state-federal 
vocational rehabil i tat ion program 
is nowhere near big enough to serve 
our young handicapped population. 11 
There i s al so a prevail ing attitude 
on the part of many educators that 
the students they encounter, because 
of so many behavioral and even 'skill 
related problems, will simply never 
be employable. They give up, in a 
sense, <*nd resolve themselves to sustaining 
a program they feel can have no positive 
effect. Hippolitus (1980) also states 
"occupational negativism about disabled 
people stiffles creativity and creativity 
is the ma^k of a good education program. 11 
The importance of disabled youth learning 
career related skills while in the 
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school system ca;;not be understated 
since the chances for them to obtain 
such skills elsewhere are minimal 
even through the state- federal vocational 
rehabilitation program. The result 
of course is a tremendous waste of 
manpower. Bowe (1980) found unemployment 
rates in excess of 50% for handicapped 
adults. 

Instructional programs for disabled 
youth need to be career related but 
not job specific because of many 
job^ changes may occur throughout 
an individual 1 s years of employment. 
It makes good sense however, to relate 
career programs to actual employment 
settings in the local area or community. 
Special educators must learn to make 
thei r programs ref 1 ect the real ity 
of the local labor market much as 
vocational evaluators have learned 
to design assessment tools based 
on local industrial operations. 
This implies the use of job analysis, 
another tool used by vocational reha- 
bil itators, and may also be another 
point of interaction between educators 
a n d empl oye r s . Re ha b i 1 i ta ti on f aci 1 i ti es 
can also be a val uabl e resource i n 
f urtheri ng the special educator 1 s 
link with employers. McCray (1984) 
states that "most facilities have 
worked with secondary level school 
based programs providing specialized 
servi ces 1 i ke vocati onal eval uati on , 
work adjustment and job placement." 

A visit to a facility can provide 
an educator with a basic understanding 
of training and work modification 
which could, in turn, prove most 
val uabl e i n the devel opment of special ized 
methods in their school settings. 

When applying technology or 
modifying instructional design for 
handicapped youth perhaps the best 
resource is the student. An individual 
who has lived with a disability may 
be well aware of what is needed to 
overcome its effects. Special products 
may then be found or a change in 
method i ni tiated. Perhaps the best 
place to start looking for equipment 
and aids to meet special needs i s 
the ABLEDATA system. 
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ABLEDATA consists of a national 
computerized databank containing infor- 
mation about rehabilitation products 
and a network of information brokers. 
This resource includes more than 8,000 
commercially available aids and equipment, 
to date useful to disabled persons. 
Another resource is the Vocational 
Studies Center at the University of 
Wisconsin-Madison. An updated catalog 
is available from the Center entitled 
Tools , Equipment and Machinery Adapted 
for the Vocational Preparation and 
Employment of Handicapped People . 
This catalog contains descriptions 
and illustrations of 283 products 
modi f i ed for used in the vocational 
education and employment of handicapped 
people. The Center also publishes 
a handbook entitled " Puzzl ed About 
Educating Special Needs Students ?" 
The handbook is ready reference to 
modifying instructional methods for 
special needs students. Other references 
are available from the President's 
Committee on Empl oyment of the Handicapped 
which the reader may wish to uote 
in the reference section of this paper. 

The techniques used to remove 
barriers within learning environments 
should be related to the techniques 
that may eventually be used to modify 
employment settings. Furthermore, 
all "vocational" modifications or 
applications of technology must be 
realistic in terms o\ appl icaLil ity 
to actual available, or potentially 
available occupations. Employers 
confronted with hiring a disabled 
person will be more likely to accept 
a person who has already demonstrated 
success with modifications in learning 
situations which were similar to the 
kinds of tas ks conta i ned in thei r 
industry operations. 

Educators must also be aware 
that employers are mush more willing 
to accept modifications that are simple, 
efficient, low cost, and that do not 
effect other workers using the same 
work station. High technology applications 
can produce amazing results but educators 
must strive to first maximize the 
abilities of the individual and then 



to apply technology only where necessary. 
This approach, alt ho ugh demand ing 
of much creativity and insight, keeps 
the individual's potential and inde- 
pendence high while keeping the cost 
and burden of technology at a reasonabl e, 
acceptabl e 1 e-'ol . The practice of 
creating simple c'-nc! efficient modification 
also results In a higher student 
acce ptance . Educators shoul d desi gn 
modi fi cat ions that are the least 
conspicuous and do not draw attention 
to the ha ndi capped thus increasing 
the normalization element of the 
process . 

The goals of rehabilitation 
tech no 1 ogy are di recti y related to 
the objectives and endeavors of educators 
and employers. They are: to expand 
i ndi vi dual vocati onal opti ons ; to 
enable disabled persons to pursue 
more teachi ng and training options; 
to increase successful employment; 
^nd to increase productivity. Applying 
technology in comoination with other 
sui ta^l e modi fir at ions provides a 
common link* a starting point, where 
all cjneprned pro fessi onal s can, 
wi th barri ers removed , move toward 
achieving the highest level of satis- 
factievi and performance for their 
students and employees. 

Instructional Catalogs and Material s 

are Available From: 

The Vocational Studies Center 
University of Wisconsin-Madison 
265 Educational Sciences Building 
1025 W. Johnson Street 
Madison, Wisconsin 53706 
(608) 263-4357 

The following publ ications are available, 
free of charge by writing: Paul 
Hi ppol i tus , President' s Committee 
on Empl oyment of the Handicapped , 
Washington, DC 20210: 

"Resources for the Vocational 
pre pa rati on for di sabl ed youth 
- An annotated bibl i ography 
and resource list for information 
on the prevocational , vocational 
and career education of disabled 
students. 
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"People - Just Like You" 

• A six hour lesson plan for 

teachers of non-handicapped students 

on disability and the potential 

of disabled people. 

"Blueprint For Action" 

- A comprehensive review of current 
"issues and barriers facing handicapped 

youth in education and training 
with suggested steps for local 
groups and individuals. 
"CETA - An Employment and Training 
Resource for Disabled Young Adults" 

- A review of the advances made 
by the 1978 CETA amendments and 
their potential for handicapped 
youth. 

REFERENCES 

Bowe, F. (1980). Rehabil itation of 
America: Toward maki ng di sabled 
people independent . Ne* York: 
Harper and Row. 

Hippolitus, P. (1980). "Mainstreaming: 
The true story." Disabled USA , 
(8), pp. 5-8. ~ 

McCray , P. (1984). Rehabil itation 
Facil ities Foster Handicapped Students 
Transition From School To Work . 
The RTC Connection. Menomonie, 
Wi scons i n , Research and Trai ning 
Center, Stout Vocational Rehabilitation 
Institute, University of Wisconsin-- 
Stout. 

Author 

Wm. F. Johnson 
Media/Training Specialist 
Research & Training Center 
SVRI 

UW-Stout 

Menomonie, WI 54751 



MICROCOMPUTERS AS PROSTHETIC AIDS 
FOR THE SEVERELY PHYSICALLY DISABLED 



MARILYN LONG 
PANELLA KICKS 



ABSTRACT: Tremendous techno! ogi cal 
increases resulting from the boom 
in microcomputer development has had 
an explosive impact in the development 
of special aids for disabled persons. 
Successful applications of technology 
have lessened the discrepancy between 
the individual's capabilities and 
his environmental demands. The artificial 
intelligence of the microcomputer 
has be<in integrated into the design 
of pnwer prosthetic or robotic manipu- 
lators. Another area of prosthetic 
assistance to the severely disabled 
has been the development of communication 
aids; two major categories of communi- 
cation aids employ microcomputer tech- 
nology. Numerous factors are included 
in the selection of a communication 
device. The particular device selected 
must possess the capability to be 
operated independently and by designed 
to meet the individual's needs. The 
microcomputer 1 s assi stive capacities 
enable those individuals previously 
thought completely disabled the ability 
to assume some measure of productivity. 
The microcomputer offers the means 
by which an individual may control 
his surroundings and himself, as well 
as communicate with others. The aids 
discussed in the text represent successful 
application of advancements in micro- 
computer technology. 
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The past few years have witnessed 
a tremendous increase in technology 
with the advent of the microcomputer. 
In conjunction with the explosive 
impact of the microcom: Jter has been 
the impact of individuals and small 
groups involved in the devel opment 
of special aids for disabled persons. 
Interference wUh mobil ity $ mani pulation 
of the environment and effective 
communication caused by various neuro- 
logical and neuromuscul ar condi tions 
has been overcome wi th the use of 
artificially i ntel 1 i gent prosthetic 
devices . These aids have all owed 
individuals the ability to be as 
i n dependent of constant at ten ti on 
as po ssi bl e and to enhance thei r 
way of life* 

Mobility has heen one of the 
most acute requirements of handicapped 
persons. Without mobi i ity the individ- 
ual's capabilities wer* severely 
limited. Good, reliable powered 
wheelchairs were an outgrowth of 
the mobility neecs of chr handicapped. 
The Wheelchair II Workshop held at 
Moss Rehabilitation Hospital, December, 
1978, recognized thH the 'Microcomputer 
offered vast imprc jments ovtv existing 
control systems. The microcorr. uter 
provi ded the sophistication, flexi- 
bility and compactness required for 
such features as automatic speed 
limiting, programmed eo-cel era t ion 
an deceleration, c! s tacit avoidance , 
ba ttery moni tori ng , and component 
temperature monitoring (Aylor, Johnson 
& Ramey, 1981). 

The University of Virginia Rehabil i- 
tation Engi neeri ng Cet'ter developed 
a mi croprocessor- based wheel chai r 
which provided many cf the aforementioned 
functions . Critical characteristics 
of the control system were v^/ied 
by programming changes to meet 'ndi vidua 1 
needs. A digital filter ng system 
extracted the average value of spastic 
hand movements of the joystick thus 
enabling i ndi vi dual s with severe 
spasti ci ty to smoothly and safely 
operate the wheel chair. Additional 
flexibility was obtained by a variety 
of control inputs such as joystick, 
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sip and puff, and hum control. The 
microcomputer permitted accommodation 
of these different inputs by using 
separate written subroutines. Not 
only did this accommodate the individual c s 
residua] capacity to exercise control 
of the wheelchair, but it minimized 
hardware interfaces between the user 
and the microcomputer. This flexibility 
made this wheelchair system much more 
tailored to the unique capabilities 
of the user. The intelligence offered 
by the microcomputer made possible 
a variety of compl ex features whil e 
maintaining hardware simplicity and 
low *power consumption (Aylor, et al., 
1981). 

Similar technological applications 
have expanded user control from wheelchair 
to environment. Past difficulties 
with robotic mani pulators were eliminated 
by the microcomputer ability to develop 
and remember complex movement command 
chains for specific types of activities. 
The user then directed these routines 
with only a few commands, thus making 
complex motions with reasonable speed 
and accuracy ( Vanderhei den , 1981). 
A number of devices have been developed 
to provide general motions under the 
operators control . One such manipulator 
was developed by the John Hopkins 
Hniversity for the Veteran's Admini- 
stration. The operator moved the 
terminal device to any position in 
its range by operating one joint at 
a t i me . A similar de vel opment by 
the Jet Propulsion Laboratory under 
the joint sponsorship of the National 
Aeronautics and Space Administration 
(NASA) and the Veteran's Administration 
utilized voice command control (Ramey, 
Aylor & Williams, 1979). The University 
of Virginia Rehabilitation Engineering 
Center developed a single chip micro- 
computer control system which allowed 
for joystick or hum control of a wheel - 
chai r-mounted mani pul a tor . Another 
versatile system developed by Ramey, 
Aylor and Williams (1979) permitted 
severely handicapped individuals to 
eat i ndependently using a microcom- 
puters-control 1 ed mani pul ator . The 
microcomputer not only moved the eating 



utensil through a preprogrammed path 
and rotated the plate, but it also 
possessed a "learning mode" which 
enabled its adaptation to tasks other 
then eating (Freedy & Lyman, 1977). 

Further, a pro gramma bl e robotic 
arm developed at the John Hopkins 
University Applied Physics Laboratory 
was i nte grated i nto a functional 
worktable, thus giving persons without 
the functional use of their 1 imbs 
the mani pulative capabil ity necessary 
for reading , eating , and using a 
typewriter , telephone and personal 
computer system. Experimental systems 
with the robotic arm have been proposed 
and designed in both wheelchair and 
table-mounted versions. This system 
was operated by the same control ler 
whi ch ran the el ectri c wheelchair. 
This arrangement permitted full wheelchair 
mobil ity with mi nimal additional 
components mounted to the wheelchair, 
thus maintaining a 1 ow- prof il e wheelchair 
(Sc hnei der , Schmei sser & SeSmore , 
1981) . The robotic arm/worktabl e 
system was designed for the high-level 
quad who , having no use of his arms 
or hands, was capable of nearly a 
full range of head and neck movement 
and could use a mouthstick for turning 
pages and operating a keyboard. 
The controller responded' to commands 
from the user and his environment 
and comma nded the mechani cal arm 
to perform some useful motion. The 
software desi gn for the controller 
impl emented all tasks necessary for 
the proper operation of the mechanical 
arm either as a tel emani pul ator or 
as a robotic arm. Through cl inical 
tests of the system, the computer 
was shown to be a significant factor 
in the design of the robotic arm 
control system as wel 1 as a key component 
of the wor ktabl e . The desi gners 
have planned attempts to broaden 
the task capabi 1 i ty of the device 
(Hazan, 1981). 

Erich Sutter of the Smith-Kettlewell 
Institute in San Francisco has developed 
a seemingly tel epathically controlled 
computer. To control computers, 
telephones, lights and other electronic 
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devices the user would gaze at a flashing 
light; brain waves and computer software 
would do the rest. To use the system, 
electrodes like those used for an 
electroencephal a gram needed to be 
worn. The system utilized a separate 
light for each device to be turned 
on or off or for each choice to be 
made. These 1 ights flashed in a carefully 
chosen pattern, a repeating sequence 
taking nearly three seconds to complete. 
The viewer responded to the flickering 
with a distinctive pattern of brain 
waves that changed recognizably as 
the di f f erent 1 i ghts fl ashed thei r 
sequence. The computer compared the 
user's brai n waves with a pattern 
in its memory. When a matching pattern 
was found, the computer knew which 
light was looked at and operated the 
device. This system was used to communi- 
cate, to command light switches, tele- 
visions and even meal-carrying robots. 
This system even enable those who 
could neither type nor speak to enter 
text into a computer by simply gazing 
at a single character on a display 
board, 

Yet, another area of prosthetic 
assistance co the severely disabled 
has been the development of communi- 
cation aids. The nonvocal disabled 
person entering the mainstream of 
society was faced with communication 
problems mQre severe and complicated 
than encountered by individuals in 
a foreign culture. Oral communication 
was spoken at such a high rate of 
speed that few people had the patience 
or attention span necessary to communicate 
wi th a di sa bl ed i ndi vi dual us ing a 
si ow manual communi cat ion aid such 
as a laptray letterboard. To communicate 
effectively, nonvocal disabled individuals 
needed communication devices specifically 
designed to meet their particular 
and practical re qui rements wi thi n 
today's society. At the Biomedical 
En gi neeri ng Center of Tufts - New 
England Medical Center, the communications 
probl ems of disabled people were addressed 
through a coherent philosophy of electronic 
device development (Thomas, 1981, 



p. 25). This philosophy stressed 
personal , portable and affordable 
as key concepts. 

Currently, two major types of 
communications /stems for the nonvocal 
disabled have bean manufactured commer- 
cially: a scanning system that presur- 
poses a user with voluntary motor 
control of one muscular action and 
a direct selection technique, usually 
accompl ished with a mouthstick, hand/arm 
control, or a. headpointer of some 
type. The Direct-selection technique 
has required better muscular control 
than for the scanni ng system , and 
fatigue has played an important role 
in communication speed (Thomas, 1981). 
Generally, the majority of communi- 
cation devices utilizing microcomputer 
technology of late, have been capable 
of functioning in either of these 
modes depending on user ability. 

One such device was developed 
by Carol A. Simpson, Ph.S., of Psycho- 
Linguistics and Douglas H. Williams, 
Ph.D., who drew on their collective 
experience in developing synthesized 
voice systems for NASA. Their talking 
wheelchair, formally named Versatile 
Porta bl e Speech Prosthesis (VPSP) , 
adopted exi sti ng hardware which was 
mounted on wheelchair and run off 
a standard 24-volt wheelchair battery. 
The system further i ncorpo rated a 
microcomputer, a dish drive, a speech 
synthesizer, aM a modified five 
inch television set. 

The user had three choices to 
control the system defending on his 
physical capacities. The easiest 
and fastest met hoc: was the Keyboard 
which could be operated by finger 
touch or a headscick (Deane , 1982) . 
Using a joystick control , the cursor 
was moved to the desired word or 
letter and selected by the press 
cf button. For those too severely 
handicapped for the keyboard or joystick 
version of the VPSP, the single-switch 
lode could be utilized. In the single— 
.*wi tch mode , the computer moved the 
cursor and the user pressed a button 
to stop the scan where wanted. 
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Similar to the VPSP, another 
wheel chair portabl e device was devel oped. 
With this device, a box in the back 
of the wheelchair held the electronics, 
microprocessor and voice synthesizer; 
a display and printer combination 
was mounted on the side of the wheelchair 
where it would be most easily visible 
to the user; an adaptive joystick 
was located next to the body part 
capable of manipulating it-hand, foot, 
or head, depending on the user (Rahimi, 
1981), 

Many nonvocal individuals have, 
however, learned to communicate with 
others using devices such as the Blis- 
symbolic Board. The Bliss Board was 
composed of an array of symbol s . 
The handicapped individual relayed 
a message by indicating the set of 
symbols representing the intended 
meaning. Since Bl i ssymbol ics is a 
purely graphic communications system, 
interpersonal communication has required 
the presence of an interpreter familiar 
with the system for translating Bliss 
Syntax into English. A significant 
advance for Bl iss users was the development 
of computerized talking Bliss Boards 
such as the Semantical ly Accessible 
Language (SAL) Board. SAL combined 
microprocessor and speech synthesis 
technology to create a portable lap 
Bliss board permitting the nonvocal 
user to more freely communicate by 
producing synthesized English speech 
from Bliss symbols (Ben.ett, 1982, 
p. 111). These devices also allowed 
users to compare ideas before speaking 
(Rahimi, 1981). 

Summary 

The previously mentioned prosthetic 
aids for the severely physically impaired 
were devel oped as a direct outgrowth 
of the microcomputer hoom. Artificial 
aids -- communication or otherwise 
« can improve the quality of life 
for the disabled. With technological 
advances such as they are, the resources 
are available to build aids to compensate 
for many disabling conditions. Micro- 
computers have brought independence 
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for the disabled closer because so 
many assistive devices are functionally 
dependent on computer software rather 
than expensive hardware ideally, 
pros the ti c and communi cati ve ai ds 
require customizing for individual 
needs. With the programming abilities 
of microcomputers, inexpensive software 
and standard devices such as pi ug-in 
memory modules, plug-in keyboard 
layouts, and modular display or audio- 
output options, the severely disabled 
individual is able to participate 
more fully in the mainstream of society. 
The aids discussed in this text are 
but a few of the products of the 
creativity in design boosted by the 
microcomputer. 
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ETHICAL DILEMMAS—DIFFERENCES IN THE 
PUBLIC AND PRIVATE FOR PROFIT 
PRACTITIONERS 1 POINT OF VIEW 



MICHAEL C. McCLANAHAN 



ABSTRACT: Ethics, or the "rules or 
standards governing the conduct of 
the members of a profession" (Houghton 
Mifflin, 1976) is a central issue 
confronting professionals in rehabili- 
tation. A review of the editorial 
sections of the most recent issues 
of The Journal of Rehabilitation show 
the nature of the ethical issues. 
The emergence of the private profit 
sector in rehabilitation is the source 
of this ethical dilemma. This pap:r 
considers the ethical issues confronting 
rehabilitation practitioners in the 
private profit and public sectors. 



Ethical Issues— The Literature 

Nadol sky (1984) , is critical 
of professionals in both sectors, 
claiming that "...publ ic agency personnel 
ascribe to a bel ief in individual ization 
of service principles; in actual 
practice they often submit to organi- 
zational pressure and fail to provide 
those individual ized services that 
will enable their cl ients to achieve 
an optimum level of functioning ..." 
while personnel in the private for 
profit sector" " . . .find themselves 
submitting to the pressures and require- 
ments imposed by i nsurance companies 
...a perspective that does not enable 
them to ascribe to the individual ization 
of service or the optimum functioning 
pri nci pi es . " Three rebuttal 1 etters 
to the editor in the following issue 
of the Journal of Rehabilitation 
(Atkinson, et al . , 1984) , arrive at 
the same , apparently i n dependent , 
conclusion that the only "crisis 
in rehabilitation" is Nadol sky's 
perception. 1984). A review of the 
literature would suggest that their 
response is erroneous and defensive. 
Although Nadolsky's editorial has 
touched off a multitude of exchanges, 
debates, articles, and correspondence, 
his concern is not new. Matkin, 
(one of the critical respondents 
to Nadolsky's editorial), and May 
(1981) published an article 3 years 
ago on the potent i al conf 1 icts of 
interest in pri vate rehabil itation 
and concluded that the private for 
profit sector brings with it a number 
of ethical concerns due to the strong 
profit motive, the diversity of quali- 
fication levels of its practitioners, 
and the lack of a regulatory governing 
body. Two years prior to Matkin's 
study, Lewin, Ramseur and Sink (1979) 
expressed similar concerns rel ated 
to the role of private rehabilitation 
efforts . More generic to the f i el d 
of rehabilitation is an article on 
ethics published by Geist, Curin, 
Prestridge and Schelb (1973) in which 
they state "...Because of administrative 
and bureaucrat i c efforts for sel f- 
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survival, the agency no longer serves 
the counselors, but rather the counselor 
works chiefly to sel f-survival . . .some- 
where, along the line the client and 
his needs get lost." In 1981 the 
National Association of Rehabilitation 
Prof ess i onal s in the Private Sector 
(NARPPS) adopted its "Standards and 
Ethics" (NARPPS, 1981) and created 
a review board to consider complaints 
of unethical conduct of its members, 
and empowered that board to revoke 
membership if necessary. In addition, 
the creation of the Commission on 
Rehabil itation Counselor Certification 
(CRCC) and its Code of Ethics empowers 
that organization to "...suspend or 
revoke certification upon violation 
of the Code of Ethics" (CRCC, 1981). 
Tuck (1983) i nsi nuates transgression 
of professional ethics in the use 
of rehabilitation practitioners for 
litigation by stating that "this is 
not a traditional rol e for rehab counselors 
and, in many cases, represents a selling 
of one's professional soul" and cites 
Matkin and May (1981) as her source. 
Matkin and May (1983) respond to this 
charge saying that their articles 
did not imply the necessity of selling 
one's professional soul and that "...ethics 
rests with professional , not the work 
environment or job functions." Finally, 
Cottone, Simmons, Wilfley (1983) surveyed 
the 1 iterature of four national rehabil i- 
tation journals and psychol ogi cal 
abstracts over the time period of 
1970-1981 for articles focusing on 
ethical issues in vocational rehabil i 
tation. There conclusion was "...the!" 
were many publ i catior.s on ethical 
i ssues in vocational rehabil itation 
between 1970 and 1981, closer examination 
reveals a relative paucity of articles 
on topics specific to rehabilitation 
practice ." 

Practitioner Interviews 

In order for this writer to formulate 
as objective a set of impressions 
as possi bl e rel a ted to the ethical 
dilemmas encountered by practitioners 
in both the public and private sectors, 
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i nformal i ndi vidua! interviews were 
conducted. The opened-ended question 
was osked: 

"Do you feel that you are asked 
to compromi se the rul es or standards 
governing the conduct of the 
members of your profess ion in 
any way? If so, in what ways? 

Without except i on , i ndi vidual s 
in the private for prof it sector 
res ponded that they f el t pressure, 
ei ther impl ied or overt, to support 
the referral sources 1 point of view. 
Predominantly, the referral source 
was insurance companies , al though 
a minority of practitioners verbalized 
pressure from either the client (if 
self referred) or his attorney. 
The second most frequently received 
response from the private for profit 
practitioners was that they felt 
pressure from their respective employers 
to perform unnecessary acti vi ti es 
in order to obtain increased billable 
hours . 

An adjunct to this is that re- 
spondents also reported their billing 
transmittals were either raised or 
lowered to reflect "appropriate" 
billing amounts. 

Responses from i ndi vidual s in 
the publ ic sector of rehabil itation 
were more varied and thus more difficult 
to categori ze . The trend, however, 
was that of two responses: (1) caseload/ 
pa ;;erwor k demand? are so hi gh that 
they interfere with job effectiveness, 
and (2) the regulations and money 
constraints arc overwhelming. 

These obtained responses seem 
to va*! i date Nadol sky 1 s cl aim that 
individuals in both the private and 
public sectors experience pressure 
tc submit to organizational demands 
rather than individual needs (Nadolsky, 
1984). The individual in the private 
sector experiences pressure from 
both the insurance company and their 
own company, while the public practi- 
tioners find constraining regul anions 
and paperwork demands imposed on 
them by their agency. This further 
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validates Geist, Curin, Prestridge 
and Schelb's (1973) previously reported 
study that efforts by the counselor 
seem to be directed toward the agency 
survival rather than the disabled 
individual 's gain. 

Rehabilitation and a Changing Society 

What has been impl ied , but not 
expl ici tly stated in the 1 iterature, 
is that a growing number of rehabil i tat: on 
professionals are aware of the changes 
occurring in the field any many are 
fearful to the resulting outcome. 
Rather than seeing themselves as co- 
operating agencies and companies, 
one can sense an air of alienation 
between the two sectors, not unlike 
that of other organizations who find 
themselves with divergent backgrounds 
and somehow similar goals (e.g., pro- 
fessional and college sports, church 
and social reform agencies, public 
and private schools, etc.). Many 
in the public sector seem to be "turf 
protecting" and claim that practitioners 
in the private sector are providing 
insurance work rather than rehabilitation, 
while private practitioners sometimes 
counter with claims of ineptness of 
the public sector rehabil itationers . 

This state of anxiety regarding 
the future state of rehabilitation 
has the potential to be a "healthy 
fear." The field of rehabilitation, 
if it is a dynami c f iel d , has been , 
and always will be in a state of tran- 
sition. The field will continue to 
reflect the transition of society 
so that practitioners respond to the 
real needs of the people. Nadolsky 
(1984) remarks that private for profit 
practitioners are ".. .serving to redefine 
the rehabilitation process... 18 and 
that "...programs have cast aside 
certain basic principles that have 
been historically associated wi th 
the rehabilitation movement..." Is 
this necessarily and evil? We are 
presently redefining which people 
might be considered "handicapped" 
and therefore qualify for rehabilitation 
service, either private or public. 



Publ ic vocational rehabilitation 
counselors, if given an opportunity, 
will reflect on "the good old days 
of V.R." when the ^-H's" were easy 
"26" closures. This handicapping 
condition has been redefined. In 
the embryonic stage of the private 
for profit movement, many professionals 
were reported to be totally biased, 
always favoring the referral source. 
With the demise of a number of private 
agencies whc were viewed as non-credible, 
the survivors have learned that objec- 
tivity (a quality product) has more 
substantial long-term benefits. 
As credi bi 1 i ty i ncreases , so do referral s 
from all sides of the legal posture 
(i.e., defense and plaintiff). Sink 
and Craft (1981) suggest that as 
medical technology advances persons 
over 65 might one day qualify for 
rehabil itation services as life expectancy 
grows, so that the elderly will become 
a resource rather than a drain. 
In addition , medi cal advances will 
cause the very nature of rehabilitation 
to change as do the needs of society 
(Spears , 1983 ) . Naisbitt (1982) 
notes the coming in of the information 
age and the exit of the industrially 
based society, reflective of the 
fact that clerk jobs became the number 
one occupation in 1979, replacing 
laborers, which replaced farmers. 
Women will constitute 47% of the 
wor k force and thei r i ncome will 
compri se 40% of the average family 
income. As society changes, the 
field of rehabilitation must also, 
to keep pace. 

Private and Publ ic— Mutual ly Beneficial 

What the private for profit 
movement has successfully done, is 
respond quickly and effectively to 
the chang i ng nature of soci ety in 
order to meet the peopl e 1 s needs. 
Mat kin (1982) surveyed 268 NARPPS 
members and 1 isted 29 different services 
offered by the pri vate sector; a 
survey which might , in part, refute 
Nadolsky's (1984) assertion thut 
the "...provision of service to indi- 
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vi duals is limited in the pri vate-for-- 
profit sector..." The private sector, 
in addition to reduced federal spending, 
has encouraged publ ic sector rehabil itation 
agencies to heighten their business 
practices and to seek new markets. 
Professionals entering or moving about 
in the rehabilitation field will begin 
to find themselves with some 1 evel 
of bargaining power for salaries and 
prerequisites as there is more than 
"one show in town." As litigation 
i n creases , so will accountabil ity , 
which will ultimately result in better 
and more efficient services for disabled 
individual s. 

Ethical dilemmas encountered 
by practitioners in both the public 
and private for profit sectors is 
the topic of this paper. It has been 
shown that a remarkable similarity 
exists between the two sectors in 
terms of temptations related to pro- 
fessional conduct. The solution to 
the issue of handling ethical dilemmas 
is also remarkably similar. Professionals, 
individually and collectively, must 
ardently adhere to the principles 
governing their profession. Strong 
profess ional organ i zat ions , solid 
educational programs, both in-service 
and formal, are necessary for growth. 

The intent of this paper was 
to compare and contrast one aspect 
of the two sectors. The similarities 
having been noted, a word of caution 
is due. The two movements, although 
strikingly similar in some ways, is 
markedly different and non-comparable 
in others. In some aspects, it is 
like comparing apples and oranges, 
or sounds and smells. The ultimate 
conclusion in attempting to compare 
two totally different realms might 
1 ead to a concl us ion in the form of 
the rhetorical question: "What does 
an E-flat smell like?" 

Mercer (1979), commenting on 
professional behavior concludes that 
"we must assume personal responsibility 
for earning professional respect through 
active concerns and involvement." 
Marvin Spears (1983) so aptly put 
the status of rehabilitation as a 



function of society and states "Rehabil i- 
tation. „ .is changing, and will change 
drastically in the future--and will 
do so at a pace that might be stressful ." 
Well, Mr. Spears, it i_s stressful, 
but in a po s i t i ve , heal thy way. 
The rehabilitation movement at this 
stage can be viewed as painful but 
exciting growth. Members in both 
the publ ic and pri vate sector have 
much to look forward to in this age, 
and can be proud of their pilgrimage. 
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EFFECTIVE VOCATIONAL EVALUATION OF 
NON-ENGLISH SPEAKING INDIVIDUALS 



JULIA EDGCOKB 



ABSTRACT: Increasing numbers of non-English 
speaking individuals are being referred 
to vocational evaluation units for 
assessment and vocational evaluation 
units for assessment and vocational 
recommendations. This increase is 
reflected in schools, n workers 1 
compensation systems and <n State 
Departments of Rehabilitation. Often 
the referral source has little or 
no idea of what to do with the client. 
One key to the effective evaluation 
of non-English speakers is to have 
a plan prepared prior to initiating 
evaluations of this client group. 
The issues discussed in this paper 
contribute the client's attitude toward 
the eval uation experience. The evaluation 
staff should be trained and educated 
concerning the discrete and cumulative 
effects that any of these factors 
might have upon the course of the 
work evaluation. 



Cultural Identification 

If rapport is to be established 
between the evaluator and the non-English 
s pea ki ng cl ient , the eval uator must 
make a conscious effort to learn 
about the client's culture. This 
can be done in a variety of manners, 
none of which require much cash expen- 
diture. One simpl e method is to 
go to the public library and check 
out a few books on the subject. 
This provides a minimal base which 
can be used as a spring board for 
conversation during the initial interview 
and subsequently during the evaluation. 
If the eval uation center is near 
a uni versi ty or a mi 1 ita ry base , 
knowledgeable people are often available 
to speak to the staff about the cultures 
and social customs of many countries 
from whi ch the non-Engl ish speaking 
clients come. Many military personnel 
have received specific training about 
proper behavior when working with 
members of different cultures and 
they are generally flattered and 
eager to discuss what they have learned 
with a receptive audience. Other 
human resources include organizations 
or self-help groups that are frequently 
formed in non-English speaking communi- 
ties . 

Eval uators must take the initiative 
in learning the basics of the culture 
of the people with whom they are 
working. The necessity for this 
is at least two-fold. First, cultural 
basics should be learned so that 
no cultural fauxpas are made by the 
eval uator. These woul d quickly sabotage 
further eval uation efforts . Second , 
when working with non-English speakers, 
eval uators must exhi bit an interest 
and knowledge of the client's cultural 
values and beliefs. If this initiative 
i s not percei ved by the cl i ent , the 
evaluator will be categorized as 
being another member of the dominant 
cul ture who does not care enough 
to show the cl ient the respect due 
him or he r as and i ndi vi dual human 
being whose language and belief system 
differs from that of the eval lc lor. 
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The client will then separate from 
the evaluation, viewing it as an alien 
and futile process to mime through 
while hoping it will not cause any 
more harm to their situation. 

Communication/Linguistic Styles 

Unfortunately, well intentioned 
attempts by Engl ish speakers to ~ommunicate 
in languages they do not know sometimes 
result in inadvertent insults, which 
put cl ients off quickly. It is commendable 
to attempt to communicate in the client's 
pr i ma ry 1 anguage , even if only in 
greetings and thank yous, but the 
evaluator must be sure that the words 
used convey the requisite level of 
res pec t for the person addressed , 
are presented using the appropriate 
gender forms and are spoken using 
the proper tonal qualities. In Romance 
languages (e.g. French, Spanish, Portu- 
guese, Italian), there are two forms 
of "you", one familiar and one formal. 
When an evaluator uses the familiar 
form ("tu"), the client has immediately 
been linguistically delegated to a 
lower level than the professional 
person, and a barrier has been erected. 
Many Asian languages are dependent 
on tone for meaning, and if an incorrect 
tone is used the meaning changes. 
Some Asian languages also share different 
forms of address denoting varying 
level of respect. It is preferable 
to speak in English than to inadvertently 
insult the clients when they walk 
i a the door. 

Language is not confined to verbal 
communication in this context. Body 
language and touching customs are 
equal ly important, and the eval uator 
should learn what is usual and acceptable 
prior to evaluation to avoid potential 
misinterpretation of actions. It 
can be deduced that a person who speaks 
no English does not spend a great 
deal of time in close contact with 
members of the dominant cul ture and 
thus feels extremely awkward when 
entering an experience as unfamiliar 
as vocational evaluation. Again, 
it is incumbent upon the evaluator 



to have studied the subject and to 
set a tone in which the client can 
feel comfortable. 

Now, if the evaluator does not 
speak the language of the client, 
and vice versa, what then? The answer 
of choice is to have a staff member 
fluent in the language of the client. 
This is a rarity, in my experience. 
The next option is to go to the community 
based organizations mentioned previously 
for interpret or services. One drawback 
is that the eval uator has no control 
or understanding of what is being 
said to the client, and thus concern 
exists regarding the preservation 
of consistency in work sample presen- 
tation. Frankly, unless other language 
instructions exist in written form, 
there is no consistency in alternate 
1 anguage i nstructi ons , except when 
using the measuri ng i nstruments of 
companies that have made the commitment 
to offer their manuals in other languages 
(e.g. , Val par). 

When an eval uation center must 
use the services of an interpreter, 
the interpreter should spend a day 
in orientation , reading the manual s , 
pre pari ng the technical vocabulary, 
and engaging in discussion with the 
evaluation staff about what work 
evaluation is and the importance 
of not engagi ng in behaviors that 
will prejudice evaluation outcomes. 
An uninformed interpreter can do 
a great deal to skew evaluation results, 
and the responsibility for this rests 
on the supervisory evaluation staff 
members. 

The least desirable situation 
is the one where no one can communicate 
with the client. When this occurs, 
the eval uator must deci de whether 
to continue the evaluation via pantomine, 
or to terminate. If the decision 
is made to continue, the evaluator 
shoul d make clear statements in the 
report regarding the limited nature 
of the evaluation and should be extra 
cautious regarding the concl usions 
and assumptions he or she makes, 
based on the accumulated data. 
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When working with a non-English 
speaker, the evaluator should employ 
empathy. Putting oneself in the cl ient's 
shoes often aids in the making of 
the decisions required in J: hi s evaluation 
process. 

Irani grat ion Questions 

This is not a section debating 
if the client is in this country legally. 
That in not necessarily in the domain 
of the vocational eval uator and wil 1 
not be discussed in this paper. 

Most non-En gl ish speakers are 
first generation immigrants to this 
country, and share the proMems a>;d 
concerns that immigrants have historically 
faced. They often share great feelings 
of hope and feelings of fear and cultural 
alienation. Some speak no English 
because they say giving up their primary 
language is like giving up their identity 
and their pasts. It becomes a question 
of loyalty to the culture of origin 
and a quest to retain the roles and 
status they had (or would have) attained 
had they not come to the United States. 

Other reasons for not speaking 
English include fear of making mistakes, 
embarrassment because of an accent, 
lack of exposure to English speakers 
or even a lack of foreign language 
learning aptitude. 

The immigrant status of the client 
should' lead the evaluator to get infor- 
mation concerning the reasons for 
immigration, the conditions (is your 
client a "boat person"), the length 
of time in the United States, the 
geographic location of the client's 
family the academic training the client 
received in the "old country", the 
client's previous social and vocational 
status , etc. 

There is again a two-fold reason 
for these questions. First, they 
give the evaluator information on 
which evaluation plans and ideas can 
be based and , second , they give the 
client a chance to express his or 
her individuality and pride concerning 
t hems el ves and their accompl ishments. 
If these types of questions are not 



asked, there is a danger that clients 
wil l be stereotyped , and stereotyped 
Ux*::.it1 vely. Non-Engl ish speaking 
i : synonymous with being uneducated, 
assumptions are made regarding 
v arable skills and the like, 
tKfc il uati on becomes a tool for 
th Q '.'-'Intent, rather than for the 
b of the client. Unless the 

e»aivu >r takes the time, during 
the cc;t *se of the evaluation, to 
get to know the individual, the recom- 
mends lens will start to become "canned" 
and t!iw evaluator will be conducting 
sub-s'andard vocational eval uati on. 

an aside, these conversations 
often bring out fascinating stories 
of 1 i fe in other countries and of 
the di f f icul ties encountered during 
the trip to the United States. Parti- 
cipating in discourse with the client 
will often bring about a mutual respect 
and education that would not otherwise 
occur. An evaluator should never 
underestimate huw much they can learn 
from their clients, especially when 
communi cation can be established 
with non-English speakers. 

The Disability 

The perception of di sabil ity 
and its proper treatment is culturally 
i nf 1 uenced. One more area in which 
the vocational eval uator needs educating 
is in the health beliefs of the clien- 
tele. Evaluators should familiarize 
themselves with both the folk medicine 
systems (e.g., the "curanderos" in 
the Mexican communi ties) and the 
termi nol ogy used by members of the 
culture at hand to describe different 
sensations and symptoms . If this 
is not done mi sunders tandi ngs can 
occur that will lead to improper 
interpretation of physical tolerance 
data . Agai n , the eval uati on staff 
should find a community resource 
person (or group) that will come 
to the office and provide a few hours 
of i nformati ve trai ni ng. If this 
is not possible, check for information 
i n books or network wi th other pro- 
fessional s who might have some insights 
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they would be willing to share. This 
is especially important when discussing 
physical activities with the clients, 
and should not be overlooked or dismissed 
as extraneous. 

The factors that have been outlined 
so far in this paper are by no means 
comprehensive. Issues such as gender 
role identification, which is another 
important aspect, have not been brought 
out, mostly due to space considerations. 
Being cognizant of these factors, 
however, is not sufficient preparation 
for working responsibly with this 
cl ientele. 

Once the staff is fully educated 
regarding these and any other pertinent 
issues, action must be taker, to ensure 
that staff knowledge is manifested 
in staff performance. This extends 
to all office staff, not solely to 
evaluation personnel. The evaluation 
office should be set up in such a 
way so as to create an atmosphere 
that is hospitable to the non-English 
speaking client. This includes decor, 
methods of interaction that are culturally 
acceptable, and the proper selection 
and usage of culturally and linguis- 
tically appropriate evaluation tools. 
The staff and the office environment 
must reflect a respect for and a con- 
sciousness of the targeted population 
in order for effective vocational 
evaluation to take place. 

It is during the evaluation itself 
that the importance of manifesting 
a cultural respect and understanding 
comes to the forefront. If the client 
is not made to feel accepted as a 
contributing party in the evaluation 
process, the results will be skewed. 
This is where the credibility problem 
that has existed between evaluation 
professionals and this popul at ion 
comes to a head. If the client feels 
that he or she is in an al ien environment, 
test anxiety is never erased and evaluation 
performance (as opposed to work per- 
formance) becomes suspect. 

It is impossible to over-emphasize 
the necessity of showing respect and 
tact when working with this population. 
Vocational eval uation is a very frightening 



process to a non-English speaker, 
and these clients are nervous and 
anticipating a f a i 1 ur e si tuat i o n . 
Respect appears to be the greatest 
catalyst i n the reduction of test 
anxiety in this group. If respect 
is not shown, the evaluutor loses 
the client's motivation to do his 
or her best, as the client feels 
there is no poi nt because derogatory 
decisions have already been made 
and cast in stone. 

When this happens it 1 eads to 
the ma ki ng of recommendations that 
can be unreal i sti c or even counter 
productive. It is up to supervisory 
evaluation professionals to assume 
the responsibil ity of properly educating 
their staffs to ensure that the non-- 
Engl ish speaking cl ient is given 
the same opportunity to benefit from 
evaluation services as the English 
speaker. When this effort is not 
made then, as has sometimes been 
the case, vocational evaluation becomes 
a tool to excl ude peopl e from the 
labor market, rather than a bridge 
to vocational success. 
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A TRIADIC APPROACH TO THE VOCATIONAL 
ASSESSMENT OF THE INDUSTRIALLY INJURED 
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ABSTRACT: For many years the vocational 
assessment of thp industrially injured 
worker has been standardized on a 
sequential two-step approach - psycho- 
metrics and work sampling. The Occupa- 
tional Rehabilitation Center has added 
a third, work tolerance screening, 
which has effectively allowed the 
development of a unique program with 
comp ehensive results. As a holistic, 
measurable approach, it has added 
a new dimension which allows all phases 
of assessment to interface completely 
with more successful outcome. 



Various standardized psychological/ 
psychometric tests are used at ORC 
to assess an individual 's interests , 
aptitudes, i ntel 1 i gence , academic 
achi evement level s , val ues/attitudes 
and personality. The selection of 
a parti cul ar psychol ogi cal /psycho- 
metric test is directly related to 
the i ndi vidual cl ient , and , is used 
only to identify personal, social 
and vocational strengths and weaknesses 
of that inr^vidual client, and predict 
his vocational potential and work 
behavior. 

Several of the worker charac- 
teri sties which presently used Psycho- 
logical/Psychometric tests are intended 
to assess and include the worker's 
abil ity to concentrate on tasks, 
comprehend and fol low instructions , 
ma i n ta i n moti vati on , communicate , 
think logically, remember, tol erate 
pressure and re 1 ate appropriately 
to co-workers and supervisors. In 
addition, such testing is conducted 
to evaluate other areas including 
stress , sensitivity to secondary 
gain, malingering behavior, and psycho- 
logical trauma. As is the case with 
both work sample assessment and work 
ca paci ty assessment , psychol ogi cal/ 
psychometri c assessment places an 
emphasis on observing the client's 
related work behaviors which may 
enhance or interfere with successful 
empl oyment. 

In general, the ORC staff uses 
psychol ogi cal /psychometri c testi ng 
when there appears to be a need because: 

1. There is a specific question 
that needs to be answered, 
including the individual's 
abil ity to concentrate, remember, 

. think logically, manage financial 
benefits, read/figure, adapt/- 
adjust, and/or cope. 

2. Data in the file is outdated, 
or seems to be outdated for 
some reason. 

3. The individual has had possible 
invol vement with head injury, 
al co hoi ism/ substance abuse , 
emotional breakdown, psychotic 
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break, and/or deterioration 
in mental abilities. 

4. There exists a need for individual 
factor/trait analysis including 
those of depression, hypochon- 
driasis, emotional stability, 
maturity level, interpersonal 
relationships, chronic invalid 
role, self-esteem, sensitivity 
to secondary gain, stress/ 
a nxi ety 1 eve! s , mal i ngeri ng 
behaviors, social maladjustment, 
somatic complaints, pain involve- 
ment, conversions reactions, 
authority conflicts, adjustment 
reaction to adulthood, and/or 
possible family problems. 

5. Behavior observation/worker 
characteristic information 
is needed, including the indi- 
vidual 8 s attitude and cooperation, 
best effort, motivation , exagger- 
ation/minimization of situation, 
ability to tolerate pressure, 
ability to comprehend and 
fol 1 ow instructions , abil ity 
to relate appropriately to 
others, and/or ability to 
perform simple/complex tasks. 

The work sample phase of our 
triadic assessment may be administered 
as either the second or final stage 
of the process. The decision as to 
the proper time to administer work 
samples will be based primarily on 
the quality and quantity of background 
medical information, the nature and 
degree of the client's impairments, 
and the evaluator's knowledge and 
understanding of the cl ient' s restrictions 
as it relates to the physical demands 
of jobs. In any case, the work sample 
phase would not be embarked upon until 
sufficient information had been accumulated 
(through background information, the 
initial interview, psychometric testing, 
etc.) to equip the evaluator to select 
work samples appropriate for the client. 
In other words, the work samples are 
not to be administered randomly or 
indiscriminately, but should be selected 
on the basis of the client's needs, 
interests , and abilities/limitations. 



In addition, those work samples which 
will provide the types of information 
needed by the vocational evaluator 
should be selected. (Nadolsky, 1971) 

Certainly, the standardized 
work sample has provided an important 
vehicle for gaining vocationally 
rel evant i nformation for ,nany years . 
Their use plays an especially important 
rol e in the vocational assessment 
of the i nd us trial ly injured worker. 
First, ma ny i ndi vidual s wi thi n thi s 
popul at ion (parti cul arl y unskil 1 ed 
and many semi-skilled "blue col lar" 
workers) may not relate well to the 
"paper and pencil" format typically 
associated with psychometric testing. 
As defined in the VEWAA Glossary 
(VEWAA Glossary Committee, 1983), 
a work sample is "a wel 1 defined 
work activity involving tasks , material s 
and tools which are identical or 
similar to those in an actual job 
or cluster of jobs." This performance 
based, "hands on", experience with 
work samples provides a practical 
situation with which the industrially 
injured worker can usually identify 
readily. 

For the adult client with prior 
work experience , the work sampl e 
can be very useful in evaluating 
whether the individual retains the 
abil ity to perform previous work 
skills or has lost that ability. 
When a determination is made that 
the client cannot return to a former 
occupation (or related job), the 
work sample becomes an important 
tool in assessing the injured worker's 
capacity and capability to acquire 
new work skills. In addition to 
the evaluation of specific work skills 
and/or more global worker traits, 
the work sample provides both the 
evaluator and the cl ient the opportunity 
to observe and consider work behaviors 
and characteristics, client interests, 
and motivation. While working with 
an industrial ly injured popul ation, 
these issues and concerns are particularly 
important for making appropriate 
recommendations and/or deve loping 
a realistic rehabilitation plan. 
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It is important to recognize 
that the work sample "experience 11 
is often the injured worker's first 
real opportunity to view himself and 
learn about his "post-injury self" 
in relationship to work. Every effort 
should be made to make this a positive 
experience , and again, the selection 
of appropriate wor!: samples is important. 
Specifically, an effort should be 
made to select work samples that will 
both challenge and interest the client 
in order to engage his/her motivation 
and best effort. In doing so the 
work sampl e "experience" wil 1 be maximized 
in terms of the work performance demon- 
strated and accuracy of information 
received regarding abilities and limi- 
tations. 

Finally, work samples are designed 
to assess the behavior and abilities/- 
1 imitations of an individual as related 
to the basic duties, equipment, and 
tools of a particular occupational 
area within a controlled environment. 
(Nadolsky, 1971) Ultimate success 
in relating the client's performance 
on work samples to performance in 
the actual work place will depend 
primarily on the experience and knowledge 
of the evaluator regarding the client's 
a bi 1 i t i es/ 1 i mi tati ons , as well as 
the knowl edge of specific job requirements 
and employer expectations. 

The final portion of the triad 
consists of the work capacity evaluation 
(WCE). To define the meaning of work 
capacity evaluation, this writir shall 
use the definition provided by Dr. Leonard 
N. Matheson, Ph.D. in hi? manual, 
Work Capacity Evaluation , in which 
he states that the WCE is "A process 
of measuring and developing an individ- 
ual 's capacity to dependably sustain 
work performance in response to broadly 
defined work demands". 

There is a definite correlation 
in our situation between measurement 
and development as it relates to the 
WCE. We try to look at the individual 
from the standpoint of capacity at 
the time of performance and to gain 
insight related to potential work 
capacity as indicated by our measures. 



The demands of the WCE can be placed 
at many levels ranging from light 
to very demanding or in many cases 
from vocational classification, the 
heavy type of work situation. 

Like any good vocational evaluation 
process, it begins with the vocational 
eval uati on pi an . Our basic concepts 
of the components of this portion 
of the assessment include: 

1. Feasi bil i ty for rehabil i tati on/ 
employment 

2. Work capacity evaluation 
devices 

3. Work tolerance screening - 
short term 

4. Work capacity evaluation - 
long term 

5. Work hardening 

6. Vocational recommendations. 

The question of feasi bil ity 
for rehabil i tati on and/or employment 
is a measure that is part of the 
total rehabilitation process. We 
use questions of empl oyabil i ty and 
skill acceptability to an employer. 

Through the addition of this 
measure, we can gain further insight 
r el a ted to i ndi vi dual / product ivi ty 
and knowledge of safety in the work 
place, and also gathering information 
about the individual ' s interpersonal 
behaviors in a multidimensional process. 
Behaviors and worker characteristics 
can be identified from either a positive 
or a negative standpoint. 

The physical capacity evaluation 
is also an effective measure for 
building communication between a 
rehabilitationist and the rehab client. 
It helps us to gain information that 
will be important for further treatment, 
informati on that will be important 
to an employer, and information that 
can be verified through observation. 

Determining whether an individual 
is ready for rehabil i tati on or employment 
is something that cannot be overstated. 
We are all aware of many cases where 
people were referred for services 
or empl oyment wi th no knowl edge of 
need or capacity. The work capaci ty 
evaluation process is just one more 
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building block related to good rehabili- 
tation processing and positive outcomes. 

The work capacity evaluation 
devices used include the WEST 2 and 
WEST 4 as manufactured by Work Evaluation 
Systems Technology of Huntington Beach, 
Cal i form" a . 

The WEST 2 is < multi-purpose 
work capacity evaluation device which 
provides measurement of whole body 
range of motion under load. This 
device also aids in the simulation 
of work demands including postural 
tool usage when adapted and used with 
WEST 4. It provides information pertaining 
to worker safety and the proper use 
of body mechanics as well as symptom 
control techniques. Like many other 
of the evaluator's tools this work 
device is categorized using the standards 
of the U. S. Department of Labor. 

The individual is allowed to 
work at various levels and weights 
depending upon their individual ability 
and capacity. The ranges of motion 
pertaining to each level and load 
are measured and reported by the evalu- 
ator. Specifics pertaining to symptom- 
atology and pain, etc., are identified 
along with worker characteristics. 

WEST 4 is a work capacity evaluation 
device used to measure upper extremity 
strength and fatigue tolerance. It 
also assists in the measurement of 
the ability to utilize hand tools 
and upper extremity work capacity. 
Torque and grip strength are important 
in this process as an actual work 
situation. 

The individual works with wrenches 
and nut drivers in various positions 
with the evaluator adjusting the torque 
of the device. The specific measure 
is stopped at the point in time when 
the evaluee can no longer use the 
specific tool. Torque and grip strength 
is subsequently measured at this level. 

Work tolerance screening is a 
part of the work capacity evaluation. 
This is used to evaluate the person's 
capacity to perform work over a. specific 
period of time. This is used in situations 
where a static rather than dynamic 
measure is needed and the information 



provided is integrated into a full 
scale profile developed from the 
three segments of the total evaluation 
program. 

As part of the process , the 
physical and psychological work perfor- 
mance factors are measured and the 
demands of the work situation are 
identi f ied . The pace at which an 
i ndi vidua 1 works is also important 
in this process and gives us a baseline 
as it pertains to an individual's 
progress and assists us in predictive 
measures . 

The work capacity evaluation-long 
term is the dynamic process buil t 
from the work tolerance screening. 
By having the evaluee participate 
in speci f ic measures over several 
days, we are in a much better position 
to determine what a person is capable 
of coi ng and measure the person's 
capacity to sustain work activity. 
Once the building blocks are initially 
laid, we are capable of looking at 
the individual in terms of positive 
or negative gain. 

Work hardening as a part of 
the rehabilitation process is certainly 
nothing new. We use the work capacity 
evaluation and work tolerance screening 
in a manner to allow consistent positive 
growth. By deve loping and using 
the work capacity evaluation materials 
the ORC interdisciplinary team can 
make ah effort to re-condition the 
injured party over the period of 
time designated in initial planning. 
Outcomes from this portion will hopefully 
al 1 ow the i ndi vi dual to condi ti on 
himself to work activity and to be 
able to sustain activity without 
undue fatigue and/or pain. 

In conclusion, we are interested 
in measuring the critical work demands 
in this phase. As professional s 
in vol ved in vocational measurement 
and planning, we must assess those 
problem areas which produce symptoms 
that limit work tolerance. Through 
observation and feedback we can determine 
the individual's ability to dependably 
sustain work activity over a period 
of time. This assessment, under 
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load, assists the individual and the 
evaluator to make the best possible 
determination of vocational choices/needs. 

By combi ni ng al 1 three phases 
in this triadic approach we, as rehabili- 
tation professionals, can, from a 
phys i cal /psycho! ogical standpoint , 
profile the person by impairment, 
functional 1 imitation, feasibil ity 
for certain work activities, potential 
empl oyabil ity and earning capacity. 
Taken together, these rehabilitation 
processes help us place the realities 
of physical activity and actual work 
in perspective. 
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VOCATIONAL ASSESSMENT OF 
"CHRONIC PAIN SYNDROME PATIENTS" 



JAMES J. COSTELLO 



ABSTRACT: Vocational rehabil itation 
counseling as an integral component 
of a mul ti disci pi inary pain management 
team has been a relatively recent 
development (Tuck, 1983). Due to 
this expansion in "Chronic Pain" treatment, 
a logical extension of vocational 
rehabilitation service provision is 
to include an accurate and val id vocational 
evaluation of the individual when 
appropriate. It is this author's 
position that to increase the probability 
of a successful return to work, vocational 
evaluator skills are necessary to 
determine an appropriate match of 
cl ient to job. 

The absence of research and des- 
criptive literature regarding the 
role and function of vocational eval uators 
with this population was unforeseen. 
Therefore, the purpose of this paper 
is to describe this population, its' 
behavioral characteristics and vocational 
evaluation strategies that appear 
to be effective. 



Description of the Problem and Treatment 

Modern medicine has been unable 
to alleviate chronic pain. Therefore, 
these patients appear condemned to 
a life of pi lis, decreased acti vi ty 
levels, strained family relationships 
and financial dependency. The National 
Insti tute of Heal th estimates the 
health care cost of chronic pain 
at $40 a day per person which totals 
approximately $14 billion dollars 
a year. Thi s makes chroni c pain 
a prime concern. 

Low back pain cases, one of 
the most prevalent psychophysiological 
disabilities, are the most frequent 
to appear in vocational evaluation 
units. In California, only 15 percent 
of workers 1 compensation claims are 
for 1 ow back pai n , but these cl aims 
account for a staggeri ng 85 percent 
of that state's total annual workers' 
compensation medical budget. Conse- 
quently, significant efforts in research 
and service provision are needed 
to hel p this population regain personal , 
social and financial independence. 

Chronic beni gn pain syndrome 
is pain of greater consequence than 
organic findings would indicate or 
pain which has outlasted the initial 
degree of pathology (APA, 1980) . 
Most common is low back syndrome 
and sciatica (Stan bach , 1974 A & 
B).' Several factors appear to influence 
not only the source of chronic benign 
pain, but also to serve as behavioral 
reinforcers of the syndrome. These 
factors include the patients' s socio- 
cul tural background, family system, 
intrapersonal sel f -reinforcement , 
pre-existing psychopathol ogy, secondary 
gain neuroses, work dissatisfaction, 
i nappropriate medi cal intervention, 
negative financial incentives and 
litigation. Awareness of these factors 
is essential for vocational evaluators. 
Intervention strategies do not appear 
to be the role or function of the 
evaluator. However, if these factors 
are not incl uded in the overall rehabil i- 
tation plan, the chances of a successful 
return to work are si gni f i cantl y 
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reduced, regardless of the accuracy 
of a vocational evaluation. 

Persons experiencing chronic 
pain express their pain in a variety 
of ways. Visible and audible signals 
of pain experience are common. Guarded 
body movement, spasms, awkward gait, 
gasping and moaning are often observed. 
Many times, these behaviors effect 
the accuracy of a vocational evaluation- 
Making cons i stent observations of 
these behaviors during the eval uation 
process increases the perception of 
di sabil i ty and consequently decreases 
the avail abil ity of appropriate vocational 
opti ons . The vocational eval ua tor 1 s 
challenge is to determine the readiness 
of the client for service and make 
necessary intervention recommendations. 

Pai n in the absence of organic 
pathology, appears to be a habit which 
can be learned. Reinforcers of pain 
seem to be: 

1. Pain behaviors that receive 
direct and positive reinforce- 
ment. 

2. Pain behaviors that receive 
indirect but positive reinforce- 
ment by avoidance of perceived 
noxious consequences or time-out 
from unpleasant activities. 

3. Activity or "well" behaviors 
go unrewarded or are punished 
(Budynski , 197 3; For dye e , 
1974 and 1976). 

Fordyce and Roberts believe that 
pain clinics based in rehabilitation 
settings, with an emphasis on increasing 
physical activity, instead of a psychiatric 
setting, with its implications of 
emotional involvement, plays an important 
and positive rol e in shaping patient 
expectations and modifications. Most 
pain clinics feel that pain is what 
one feels when one hurts. The question 
is not, "Is it real?" but "What are 
the factors that influence or control 
the pain?" 

Virtual ly every body function, 
i ncl udi ng pai n , is subject to the 
influence of learning or conditioning. 
Pain problems do not begin because 
of learning, but may come to be maintained 



or control 1 ed by 1 earni ng factors. 
If 1 earning has occurred , unl earning 
can also occur. 

A common treatment strategy 
is to ignore any verbal or physical 
si gn the patient makes to indicate 
pain . Al so , the staff is trained 
to praise behavior unrelated to pain. 
The emphasis of treatment is placed 
on increasing physical activity through 
exercise. It moves the patient from 
w h a t is said about pa i n to wha t i s 
being done about it. 

Other common components of chronic 
pain programs appear as varied as 
ph il osophies toward treatment. The 
majority of pain clinics use a multi- 
di sci pi inary team staffing approach. 
This may include a psychiatrist, 
physi cal therapist, and psychologist 
on a clinic staff or be more varied 
with a physician, psychiatrist, psycho- 
logist, physical therapist, occupational 
therapist, dietitian , relaxation 
therapist, family therapist, social 
worker and vocational rehabil i tat ion 
consul tan t formi ng the staff. In 
order to be effective in treatment , 
each program must place em p ha sis 
on communication between all parties 
involved in the case. This requires 
unique awareness skills from vocational 
re ha bi 1 i tat ion special ists. They 
must be able to be a motivator, disability 
evaluator, legal expert, patient 
advocate and referral agent. 

More speci f i c impl ications for 
the rehabilitation practitioner include 
the ability to identify pain as the 
major reason for di sabi 1 i ty , the 
abil i ty to rei n force appropriate 
physical activity, and the ability 
to focus efforts on what the client 
does about pain rather than what 
is said about pain. 

Strategies During Vocational Evaluation 

Industrially i n jured workers 
suffering from chronic pain are the 
commonly referred pain patients receiving 
vocational evaluation services. 
It is important for the vocational 
evaluator to realize that feelings 



i9i 204 



of distress such as anxiety, depression 
and alienation are factors in industrial 
injury (Larson and Spritzer, 1977; 
Levi, 1979), and such stressors may 
well precipitate and maintain chronic 
pain behaviors following a relatively 
minor injury. It is quite common 
to find chronic pain patients who 
were facing layoffs at work or who 
disliked their pre-injury occupations. 

Closely related to work dissatis- 
faction are negative financial incentives. 
Financial payments for disability 
have been widely held to delay recovery 
and rehabilitation, thereby serving 
as powerful reinforcers for chronic 
pain syndrome (Better, Fine, Simmson, 
Doss , Walls and McLaughl in , 1979; 
Eaton, 1979). 

Work dissatisfaction and negative 
financial incentives appear to be 
the most significant barriers to re-em- 
ployment that the vocational evaluator 
must contend with for this population. 
Historical ly, vocational eval uation 
clientele have unrealistic occupational 
goals, lack occupational awareness 
and poor decision making skills. 
Therefore, the primary skills of vocational 
evaluators are on target for an accurate 
assessment of vocational options with 
this population. 

A short term vocational evaluation 
was described as including six steps 
(Botterbusch, 1983). These steps are: 

1. Review Case 

2. Referral Questions 

3. Select Evaluation Techniques 

4. Intake Interview 

5. Plan Modification 

6. Exit Interview 

This short term process will 
serve as a good model with the chronic 
pain population due to its need for 
specific referral questions and allowance 
for plan modification. Each of these 
steps will be reviewed with chronic 
pain patients in mind. 

Review Case 

Upon receiving referral infor- 
mation, the vocational evaluator should 



i denti fy medical and psychol ogical 
reports describing the condition 
of the client. Close attention should 
be paid to any physical restrictions 
placed on the client by the physician. 
These physical restrictions are the 
basis for discrepancies in physical 
activity displayed by the client 
during programming. Again, remember 
the premise in chronic pain treatment 
is what the client does, rather than 
what he says. 

If the client has participated 
in a chronic pain treatment program 
revi ew the di s charge report . This 
i nf ormation may give i nsi ght as to 
specific pain behavior patterns. 
As always , if you have further questions , 
a tel ephone cal 1 may be beneficial 
to your evaluation planning. 

Referral Questions 

A common probl em for vocational 
evaluators is the lack of specific 
referral questions. When this occurs, 
incomplete evaluations or inaccurate 
resul ts are generated . Be sure to 
communicate with the referral source 
prior to beginning the evaluation 
to assure comprehensiveness and accuracy. 
Returning the worker to a previous 
job appears to be current priority. 
Therefore, many referrals for vocational 
evaluation are to determine if that 
is appropriate. Be sure this is 
clarified prior to initiating the 
evaluation. 

Selection of Evaluation Techniques 

Vocational eval uation is and 
can be a very stressful experience 
for our clientele. There are indi- 
cations stressors exacerbate pa i n 
symptoms. Therefore , careful selection 
of evaluation tools is of high priority. 
Initially, an accepta bl e process 
allows the clients to select their 
preference of evaluation tools. 
Thi s will 1 ead to more commitment 
effort and follow-through on their 
behalf. Once a relationship has 
developed between the evaluator and 
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clienv, alternate techniques can be 
appl led. 

The selection of evaluation tools 
should also offer the opportunity 
for extended observation periods. 
When tools are of short duration, 
inconsistency in stated activity levels 
and observed activity levels are not 
obtained. 

Intake Interview 

Intake interviewing is a very 
i ndi vi dual skill. Each eval uator 
should continue to capitalize on their 
unique style. However, very specific 
information should be obtained. An 
outline to be incorporated into your 
informational and stylistic needs 
follows: 

A. Clients Work History 

1. Minimum of last three jobs 
(15 years) 

2. Specific job titles and 
duties 

B. Description of Accident/Injury 
C Perception of Disability 

D. Awareness of Employabil ity 

E. Present Family Situation 

F. Financial Implications Since 
Injury 

G. Explanation of Evaluation 
Process 

Gathering this information helps to 
develop a working relationship and 
provides the eval uator with insight 
to the motivation level of the client. 



Plan Modification 

Probably the most important component 
of any vocational evaluation is flexi- 
bil ity. During the evaluation, alternative 
occupational tasks are developed and 
requ i re assessment . Al so , eval uation 
termination may occur for a variety 
of reasons. Therefore, each vocational 
eval uator must be flexible in schedul ing. 
Appropriate timing of the evaluation 
and maintenance of motivational levels 
is essential to obtain an accurate 
and valid vocational evaluation. 



Exit Interview 

The final staffing, or exit 
i nterview, is the catalyst for a 
successful return to wort<. Due to 
the complexity of the cases within 
this population, networking and communi- 
cation are very high priorities. 

Al 1 individuals significant 
to the case should be invited to 
attend. Included in this group are 
the clients' family members , attorneys, 
insurance representatives, pain treatment 
staff, referral counselor and previous 
em pi oyer . The goal is to revi ew 
evaluation results and make vocational 
recommendations . Obtai ni ng mutual 
agreement and support from all involved 
is the objective of inviting all 
si gni f i cant others . Many times thi s 
is not possible, but when it occurs, 
chances for a successful rehabilitation 
outcome increases. 

Summary 

Chroni c pai n syndrome patients 
will 1 i kel y i ncrease i n numbers over 
the next decade . With recognition 
that the skills of rehabilitation 
professional s can be used to return 
them tQ ga i nf ul producti ve acti vi ty , 
an increase in referrals should also 
occur. Further research is needed 
in this area to provide documentation 
of success. It is this authors' 
contention that returning the cl ient 
to work will be a component of future 
chronic pain program models. 
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VOCATIONAL ASSESSMENTS OF 

PSYCH I ATRI CALL Y DISABLED PROFESSIONALS 



MORTON A. STONE 



ABSTRACT: The onset of psychiatric 
disability in middle life and its 
disruption to the careers of professional 
women and men has not been adequately 
addressed in the psychiatric rehabilitation 
literature. Each year thousands of 
individuals become victims of major 
affective disorders or psychotic illnesses 
causing manifold deterioration to 
their functioning as successful physicians, 
dentists, lawyers * teachers, nurses, 
etc. 

Vocational assessment becomes 
a crucial service for these victims 
of mental illness. At McLean Hospital, 
a private non-profit psychiatric hospital 
affiliated with Massachusetts General 
Hospital and Harvard Medical School, 
the Rehabil itation Services Department 
has been working on a series of standar- 
dized tests, simulated vocational 
experiences and rehabil itation counseling 
techniques to determine feasible occupa- 
tional alternatives to these former 
well-established professionals. 

This presentation will highlight 
the vocational assessment process 
by illustrating in depth three pro- 
fessional s admitted to the hospital 
and their subsequent outcomes. 



This paper will attempt to identify 
some major themes, problems, resolutions 
and outcomes of three professional 
people who became mentally ill in 
their adult years. The vocational 
assessment process in each case developed 
along unexpected lines and directions, 
mainly due to the severity of the 
illnesses and the unique psychological 
make-up of each patient. 

Botterbusch refers to six critical 
areas when evaluating disabled persons. 
He begins with a complete case history 
that consists of personal, education, 
employment and medical histories 
plus a description of present activities. 
Next, he identifies physical and 
psychomotor capacities , underscoring 
the importance of quantifying physical 
capacities as much as possible using 
accepted DOT definitions. Academic 
achievement, aptitudes and vocational 
interests comprise areas three , four 
and five. His last category for 
consideration is entitled psychological 
and emotional stability. This he 
identifies as the most subjective 
of the six areas and therefore , the 
most difficult to evaluate. 

Indeed, assessing the functional 
capacities of formerly high-level 
professional dentists, doctors , 1 awyers 
and research chemi sts after they 
have experienced the dramatic onset 
of a major affective illness or psychotic 
decompensation becomes a process 
of relative objectivity in relation 
to the subjecti veness of emotional 
and psychological stability. 

McLean Hospital , a private non-profit 
psychiatric hospital is located in 
Bel mont , Massachusetts , a suburb 
of Cambridge and Boston. It was 
establ ished in 1811 by the Massachusetts 
General Hospital Corporation and 
maintains a close affiliation with 
the Harvard Medical School. As a 
teaching and research center, McLean 
servi ces patients from many parts 
of the world and often receives referrals 
from pri vate psychiatrist who treat 
professional s from all di sci pi ines 
in academi a and corporate struct- 
ures. 
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At the time of my initial contact, 
Dr. A. had been previously hospitalized 
on three occasions dating back to 
nine years. His initial age of onset 
was twenty-eight. At that time, he 
was serving in the U*S. Navy, becoming 
grossly psychotic aboard ship on his 
way to Viet Nam. His mental status 
on admission to the U.S. Public Health 
Hospital was one of confusion, rambling, 
non-sensical talk, fearfulness and 
loose, uni ntel 1 i gi bl e thoughts and 
speech . He was treated with anti-psychotic 
medication, electro-shock therapy 
and recompensated fairly quickly. 
He received a medical discharge from 
the Navy, went into practice as a 
dental associate and soon opened his 
own practice. Despite on-going pharma- 
cological and psychotherapi es and 
two subsequent hospitalizations, he 
continued to practice, receiving a 
great deal of support from his sister 
who doubled as his office administrator. 
When his sister married and had her 
first child, leaving Dr. A. for a 
maternal leave of absence, he exhibited 
strange behavior in the office. He 
was abusive and inappropriate to his 
patients, inconsistent with his appoint- 
ments when he was abl e to keep them 
and gradually decompensated to the 
poi nt where his parents cal 1 ed the 
police to admit him involuntarily 
into McLean Hospital. 

His course of hospital ization 
was highlighted by medication changes 
and al te rat ions to respond to hi s 
manic-depressive fluctuations. Psycho- 
logical and neuropsychol ogical assessments 
revealed full scale I.Q. between 90 
and 95, memory function in the borderline 
to dull normal range, severe cognition 
dysfunctioning in the areas of concen- 
tration and task maintenance and an 
inabil ity to rel iably produce a three 
step motor program. His CT Scan revealed 
a minor abnormality reinforcing the 
neuropsychological results of cortico 
dysfunctioning in the frontal and 
temporal lobe area. 

His mental status during this 
period indicated that he could not 
tol erate ten minutes of sustained 



vocational exploration due to preoccu- 
pation with his bowel and bladder 
control and his overwhelming embarrassment 
and fear of being any distance from 
a bathroom. In addition, he was 
obsessed with the effects of the 
medication on his life. He would 
complain endlessly about his inability 
to resume his practice yet acknowledge 
the current real ities of his debil itated 
state. Another major theme of our 
meetings was his ever- P resent frustrations 
in relation to his social life. 

Much of his attention was legiti- 
mately diverted to his body because 
of the medicati ons he was taki ng. 
Periods of blurred vision, finger 
and arm tremors and leg trembling 
contributed to his inabilities to 
sustain concentration and produce 
activity of any nature. His attempts 
to receive greater disability benefits 
from the Veterans Admi ni strati on 
added to his frustrations to the 
point of applying to Social Security 
for disability assistance. In December 
of 1983, he was denied benefits and 
a secondary appeal application was 
made with this writer summarizing 
the above-stated information with 
this concluding statement, "Dr. A.'s 
attention span is severely limited 
as he is unable to focus on constructive 
work acti vi ti es outside of his own 
bodily needs. I am very pessimistic 
about hi s prog no si s to return to 
his dental practice and currently 
feel that he is limited to the minimum 
functions of activities of daily 
living." 

Dr. A. received approval of 
his appeal application in February, 
1984 . He conti nues in a community 
mental health center day treatment 
program five days per week and is 
maintained on Lithium Carbonate and 
Tegretol . 

Dr. B. was born in 1931 in Brooklyn, 
New York, the older of two boys to 
a hard-worki ng garment cutter father 
and a chronically ill mother with 
long-standing cardiac and di abetes 
problems. Mother died in 1960 at 
age 50, and father, described by 
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the patient as "a rigid and difficult 
man" died in 1973 from a cerebral 
vascular accident. 

The patient was educated in the 
public school systems of New York. 
He described himself as having a small 
group of friends, participating on 
the soccer team and being involved 
in the school's sound system programs 
and achieving B grades. He went on 
to Adelphi College as a commuting 
student which he said he enjoyed . 
He met his future wife in his sophomore 
year , graduated in 1952, and married 
in 1953 . He worked for the atomi c 
Energy Commission for one year and 
then was drafted into the army. In 
1956 , he returned to the A.E.C. and 
enrol led in the graduate program at 
Rutgers University. In 1958, he began 
his work at Bell Laboratories in Reading, 
Pennsylvania, rising from physical 
chemist to project engineer in charge 
of the measurement laboratories. 
He published a variety of technical 
papers and presented twice yearly 
at scientific meetings. He was in 
good health during this period, describing 
himsel f as a hi ghly-regarded professional 
by colleagues, a competent loving 
husband and father of three daughters, 
spending summer vacations at Myrtle 
Beach and living the good life until 
1974. At that time, six months following 
his father's death, Mrs. B. reported 
that her husband became depressed, 
staring into space in the livingroom. 
He saw a psychiatrist who treated 
him with Lithium and antidepressants 
without much effect. Ln December 
1984, he was admitted to the Reading 
Hospital, receiving eleven electroshock 
treatments. He improved considerably, 
returned to work but was confused 
and at times disoriented in his location 
and what he had been doing. In 1977, 
he was readmitted to the hospital 
for i nappropriate behavior , grandiose 
thinking, confusion and disorientation. 
His thoughts were racing, and he spent 
large amounts of money in shopping 
malls purchasing dozens of pairs of 
underwear and shirts. Bell Labora- 
tories terminated his employment in 



1978 with a disability pension of 
$6000 per year. He was hired a year 
later by Digital Equipment Corpor- 
ation, moved to Massachusetts and 
was able to function tentatively 
for one year before another ma nix 
episode hospital ized him. Digital 
kept him on their books for another 
year and finally dismissed him. 
At this time, Mrs. B. began talking 
about separation and divorce, feeling 
she could not cope with her husband's 
ups and downs and periodic bouts 
of verbal abuse. 

My introduction to Dr. B. was 
in September, 1982. He was referred 
for vocational assessment. He presented 
himsel f as a quiet , rigid, forlorn 
man of fifty- two years of age and 
out of work for a year and a half. 
His i nabi 1 i ty to attend to i ssues 
of work readi ness and focusing on 
al ternati ve career directions using 
his years of scientific experience 
was patently evident. His posturing, 
inarticulate speech and loose thought 
processes suggested the need for 
hospi tal ization eval uation. Within 
the next week, Dr. B. was an inpatient 
at McLean Hospital . 

I've been following Dr. B. for 
two years now. His 1 ife course has 
taken a dramatic downward spiral 
alternating between two i npati ent 
hospital izations , marginal independent 
living, separation from his wife 
and children, barely managing his 
daily activities, contracting diabetes 
mellitus, and his attempt to function 
in a sheltered work program where 
his attention span and memory cannot 
negotiate simple two task operations. 
Today , he recei ves Social Security 
Di sabi 1 i ty I nsurance parti ci pates 
in a psycho-social rehabilitation 
program and 1 iv*s alone* by choice , 
in a near by community. His one-time 
ambition to return to scientific 
work has ceased to be an active issue. 
It has been re pi ace d by the agony 
of living wi th a di sease that is 
unpredictable, causing him day-to-day 
changes in mood and functioning. 
The initial question at referral 
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has changed from "what alternative 
careers are open to Dr. B? to "How 
can Dr. B. maintain a life for himself 
outside of a hospital ward?" 

Dr. T., a forty-five year old 
successful dontal surgeon was referred 
to me following his six month hospitali- 
zation fo# a major depression with 
psychotic features. His admission 
was precipitated by a suicide attempt 
of self-inflicted knife wounds to 
his neck and abdomen. Our first meeting 
was highlighted by Dr. T.'s determination 
to "get out of dentistry", his agony 
of going from his kitchen to the office 
each day (the office was part of his 
home) and the on-going frustration 
of not accompl ishing "anything worthwhile" 
in his practice. He had begun the 
initial work of putting the practice 
up for sale and was seeking assistance 
to change careers. My usual course 
of assessing vocational potential 
consists of the administration of 
the Strong- Campbell Interest Inventory, 
the Forer Vocational Survey and the 
General Aptitude Test Battery along 
with a series of interviews wherein 
a compl ete hi story of personal , education , 
employment, and medical information 
are formulated. Dr. T.'s interest 
scales revealed a high affinity to 
the human services, medical services 
and scientific careers. Psychologist, 
social worker, college professor, 
minister, optometrist were "very similar" 
in the Strong- Campbel 1 Inventory. 
Dentist was low on the "similar" scale. 
The Forer revealed attitudes of perfection 
and very high needs for recognition 
by authority figures in the performance 
of work responsibilities. 

The most revealing data from 
the evaluation process, however, were 
found in his personal and educational 
history. Dr. T. recounted his high 
school experience with a guidance 
counselor who suggested a number of 
options for career directions including 
teaching and dentistry. He reported 
this information to his parents and 
remembers mother clearly deciding 
that dentistry was the route to follow. 
Being a dutiful and loving son, he 



pursued this path in undergraduate 
school, despite repeating a chemistry 
course. He was able to enter the 
Uni versi ty of Pennsyl vania School 
of Dentistry after his junior year 
at Trinity College and received his 
D.D.S. in 1963. He was married in 
his last year of dental school, served 
in the U.S. Army for two years and 
returned home with his young family 
to setup practice in a suburban town 
not far from his hometown. 

He established himself as a 
leader in the communi ty , servi ng 
on the town counsel and school committee. 
In 1975 , he began to acknowl edge 
long-standing feel ings of personal 
i n adequacy and unhappi ness . His 
younger son was experiencing major 
learning problems in school and behavioral 
probl ems at home. His response was 
often tyranni cal and heavy-handed, 
complicating family relations that 
spilled over into his work life. 
He sought treatment for his growing 
depression, receiving both psycho 
and chemotherapy. At the age of 
42, his mother died and Dr. T. became 
more debilitated. One year later, 
he made the sui ci de attempt 0 As 
we reviewed his vocational assessments 
in light of the strong psychological 
component surroundi ng his parents 
influence, particularly mother's 
perceived power and control on choosing 
dentistry as a career, "throwing 
the baby out with the bath water" 
became our focus. Through a detailed 
analysis of this work history, especially 
his military experience, a major 
theme came to the surface. He recalled 
his strong positive feelings of working 
closely with colleagues, sharing 
cases and coll aborating on difficul t 
patients. In addition, his team 
leader was remembered with fond memories 
mainly for his choosing Dr. T. as 
his second in command assisting in 
teaching rounds and cl inical presen- 
tations . As we f ol 1 owed thi s theme 
into his practice, it became clear 
that Dr. T.'s very real needs for 
approval and validation of his work 
and more importantly, of himself, 
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were not being fulfilled by his solitary 
dental practice. Despite an active 
membership in dental societies, he 
persisted in feeling a huge void in 
his "worthiness to his patients. 11 

Over a six month period, the 
cl ari f ication of hi s personal needs 
versus his professional skills became 
more separate and discrete. His psycho- 
therapist and I met frequently to 
compare notes si nee both themes were 
so enmeshed. Dr. T. began the process 
of considering teaching as an alternative 
career, speaking to local schools 
of dentistry and dental hygiene. 
He also pursued the options of group 
practi ce , 1 ooki ng into the "shoppi ng 
mall" setups. 

I'm pleased to report that just 
this past week, he became associated 
with a practice in his old hometown 
with a senior dentist he has befriended 
over the years and respects a great 
deal. Naturally, he is anxious but 
with his new insights into himself, 
his stronger alliance with his wife 
and children and his greater zest 
for living, the future looks bright. 

These three cases, I believe 
present future studies in vocational 
assessment with many challenges. 
To return to Botterbusch, if psycho- 
logical and emotional stability indeed 
are the most difficult areas to evaluate, 
per ha ps neuropsychol ogi cal testi ng 
should hold a more important place 
in the assessment process of mei/al 
disability cases. Both Dr. A. and 
Dr. B. suffer from Manic-Depressive 
Illness. Current research centers 
almost exclusively on brain functioning, 
s peci f i cal 1 y in biol ogic , el ectronic 
and neurologic chemistry. The intro- 
duction of Lithium Salts as a major 
treatment for this disease has been 
boon for si xty to seventy per cent 
of it victims. However, Dr. A. and 
Dr. B. have not been fortunate enough 
to respond favorable to this state-of- 
the-art treatment. Their 1 ives currently 
are a shadow of their former selves. 
Similar to victims of other chronic 
diseases, they wait and hope for new 
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di scoveri es to come forth from the 
laboratories. 

For Dr. T., Botterbusch' s emphasis 
on a complete case history plus the 
opportunity for extended vocational 
counsel ing provi ded important data 
for the assessment process to move 
forward in discovering vital personal 
information that affected his vocational 
functioning,, 

In summary, vocational assessment 
for vi ctims of major mental ill ness 
need to keep pace with contemporary 
psychiatric research findings. Today, 
greater numbers of young, professional 
adults, both male and female are 
being treated for affective disorders. 
Through careful review of the six 
critical areas of vocational functioning 
and an increased sophi sti cation i n 
the assessment process, hopefully 
more cl ients wi 1 1 be abl e to assume 
lives of productivity and worth. 
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A REAPPRAISAL OF VOCATIONAL EVALUATION 
FROM AN ECOLOGICAL SYSTEMS PERSPECTIVE 
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ROBERT SCHLESER 



ABSTRACT: This article will present 
a critical review of the practice 
of vocational eval uatio* from an ecological 
systems perspective. The intent will 
be an integration of both areas leading 
to a new model of the vocational assessment 
process. A description of traditional 
practices of vocational evaluation 
will be followed by an overview of 
emerging system approaches. Issues 
of environmental resources, vested 
interests, and bias will be discussed 
along with potential alternatives, 
their implications, and systematic 
tactics for application. 



Vocational evaluation grew out 
of a traditional psychological approach 
which emphasized one to one contact 
in a therapist's office and located 
the source of distress within the 
individual. Stubbins (1982) expressed 
concern that use of the traditional 
model by rehabil itation psychologist 
presented consideration of the ecological 
aspects of disability. Galvin (1983) 
noted that the clinical attitudes 
in rehabil itation fail to address 
the personal , social , and economic 
pro bl ems of di sa bl ed i ndi vi duals. 
Stubbins (1983) recommended a systems 
approach which looked at behavior 
from the perspecti ve of individual 
interaction with the environment. 

Stubbins 3 ( 1983 ) suggesti on 
paral 1 el s trends in the cl inical 
literature (Sei dman , 1983; Jeger 
and Slotnick, 1982; Schleser and 
Rodick, 1982; Rappaport, 1977) which 
ref 1 ect movement away from the traditional 
clinical model to an ecological systems 
pers pect i ve . Ecol ogi cal system perspec- 
tives stress the interaction or "fit" 
between the person and the environ- 
ment. Individual human behavior 
is seen as a function of the mutual 
interaction of various sub-systems 
(e.g., physiological and psychological) 
and supersystems (e.g., family , medical , 
communi ty) . Dysfunctional behavior 
results from faulty i nteractions 
within or across systems. 

Van Bertanlanffy (1968) defined 
a system as a complex set of components 
which interact in a predictable manner , 
are hierarchically related, and can 
be found in all areas of nature. 
Human beings can be thought of as 
a system composed of atoms, cells, 
and organs. In turn, the complete 
human organism can be seen as a simple 
component of a hi gher order system 
(e.g., family community) . Changes 
wi thi n any component of the system 
affects the entire system and a range 
of systems in the hierarchy. 

Sei dman (1983) noted that an 
impl ication of a system approach 
is the recognition and varied effects 
of stakeholders or individuals with 
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divergent values, cultural backgrounds, 
roles and vested interests. Definitions 
of and solutions to problems must 
be based on a synthesis of key stake- 
holders to assure long term change. 
Systems approaches have been utilized 
in community mental health by Jeger 
and Slotnick (1982), in family therapy 
by Schleser and Rodick (1982), and 
in medicine with Engle's (1982) proposal 
for a biopsychosocial model. 

Vocational Assessment 

An essential el ement of the rehabil i- 
tation process is the determination 
of individual capacity for work (McGowan, 
1969). Vocational evaluation provides 
a si gnif icant source of information 
for such a decision. The practice 
of vocational evaluation consists 
of a comprehensive process i nvol vi ng 
in part the systematic utilization 
of real or simulated work situations 
to assess vocational potential. Sources 
of data include medical status, psycho- 
logical adjustment, social skills, 
vocational history, educational level, 
cultural background, and economic 
factors (Tenth Institute of Rehabil itation, 
1972). Common assessment techniques, 
such as psychometric testing, work 
samples, situational assessment, on 
the job evaluation (OJE) and on the 
job training (0J7), provide a means 
for individual or group measurement 
of vocational interest, aptitude, 
and behavior within simulated or actual 
employment settings. The issue is 
whether vocational assessment provides 
appropriate data for accurate vocational 
appraisal . 

Gel 1 man (1968) identi f ied four 
goals of vocational evaluation. The 
mai n goal .was the provision of d^ta 
contributing to vocational develop- 
ment for successful rehabi 1 itation. 
A second goal was an i ndi cation of 
future work behavior along with a 
prediction of the nature and extent 
of vocational development. Third, 
vocational evaluation should specify 
behavior patterns in var i ous work 
situations. Finally, the evaluation 



should result in the preparation 
of a treatment plan. Although vocational 
evaluation provides a means to collect, 
process., and act upon vocationally 
relevant information about an individual , 
it rel ies on a 1 imited approach regarding 
determination of ability to work. 
Gellman's (1968) primary goal of 
providing vocationally related information 
doesn't address the work place, avail- 
ability to work, or incentive to 
work. Vocational eval uation may 
encourage earni ng money to become 
i ndependent but it does not consider 
the financial hardship of forfeiting 
di sabi 1 i ty insurance and beginning 
em pi oyment at a 1 ower income rate. 
The previous limitations should not 
detract from the general val ue of 
vocational evaluation and its necessity 
in the rehabilitation process. Rather 
they shoul d enl i ghten practitioners 
and consumers of areas requiring 
further refinement. 

Ecological Systems Perspective 

An ecol ogi cal systems approach 
ex pi a ins behavior as a mul ti system 
interaction involving the individual, 
family, school , occupation, and society. 
The defining attribute consists of 
concerns with effective coping strategies, 
through the development of strengths, 
instead of focusing on maladjustment 
or pathological conditions (Jeger 
and Slotnick, 1982). The ecological 
systems perspective encompasses three 
areas. Cultural relativity demands 
that individual differences be viewed 
from their cultural context. Diversity 
requires respect for personal discomfort. 
Finally, person-environment fit concen- 
trates on the identification of key 
variabl es which contri bute to the 
best adjustment between the person 
and the social / physical environment 
(Rappaport, 1977). 

Several implications emerge 
out of the ecol ogi cal systems per- 
spective. First, behavior can best 
be understood only be assessing how 
i ndi vi dual s i nterrel ate wi th their 
envi ronment . Second , identification 



201 

<" 214 



of the systems most important and 
most troublesome to the individual 
must precede any effective interven- 
tion. Third, faulty interaction between 
a person and the environment leading 
to adjustment problems can be modified 
through competency development. 

An ecological system approach 
differs from a traditional rehabili- 
tation perspective by placing emphasis 
on showing people how to acquire the 
necessary, social , political , or psycho- 
logical resources to improve thei r 
condition as opposed to provision 
of treatment and services. As a result 
rehabilitation may foster an attitude 
of personal dependence instead of 
offering a catalyst for individual 
responsibility. The key point from 
an ecological systems perspective 
for vocational evaluation is the incor- 
poration of the three areas of relativity, 
di versi ty , and per son-envi ronment 
fit as an operational philosophy towards 
the disabled. 

Integration 

Vocational evaluation viewed 
from the ecological systems perspective 
takes on new emphasis and depth. 
The ecological viewpoint, stressing 
proper fit between a person/setting, 
can serve as a validity criterion 
by identifying the content appropriate 
for assessment. One example from 
this perspective is the increasing 
rel iance on environmental measurement. 
However, often neglected areas include 
blame, decision-making, and the predom- 
inance of a clinical attitude. 

Environmental Assessment 

Environmental assessment is critical 
for the assurance of maximum person-- 
environment fit. Situational assessment, 
OJE/OJT, and labor market surveys 
are current examples of measuring 
proper adjustment. Job analysis provides 
one of the best examples of measuring 
environmental characteristics for 
a particular job. But these examples 
are not enough . Other factors such 



as accessibility, public transpor- 
tation, and employer/employee attitudes 
must be part of a thorough environmental 
assessment. 

Blame 

One potential criticism of vocational 
assessment is the tendency for the 
attribution of blame based on personal 
deficit. Individual s with di sabil i ties 
may unconsciously be viewed as responsible 
for their disability or the conditions 
maintaining it. Ryan (1976) described 
this rationale as "Blaming the Victim." 
Well meaning individuals attempt 
to justify inequality in life by 
searching for deficits in the actual 
victims of inequality. He felt the 
process occurs due to conflict of 
sel f-i n teres t. The sol ution is to 
blame problems on the past experience 
of individual s instead of inequal ity 
and then offer sol uti ons through 
social programs. The result is a 
diversion of attention from and avoidance 
of the actual source of the problem. 

In a sense, rehabil itation functions 
in a victim bl ami ng mode because 
its central purpose is the provision 
of services for amelioration of disability 
related deficits of a physical , social , 
or emotional nature. However, the 
goal of increased sel f-suff iciency 
hel ps one break out of the deficit 
cycle. The danger from a vocational 
evaluation position is to view the 
problems of a disability solely of 
individual origin. As Stubbins (1982) 
noted , "the natural way of studying 
disability and the way adopted by 
virtually all rehabilitation professionals 
is to locate the problems in the 
client" (p. 14). Reliance on blame 
allows procedure failure to be shifted 
from the eval uator to the all eoed 
personal weakness of the client. 

Alternative to this situation 
involve a change of perspective. 
Vocational eval uator s must real ize 
the mul tideterminant nature of problems 
associated with disability. Second, 
periodi c sel f- eval uat ion is needed 
to separate client i nterest form 
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self-interest and to determine attitudes 
towards the source of client adjustment 
problems. These goals could be accom- 
plished through education, peer groups, 
self-help groups, and role playing. 

Decision-Making 

Another concern is the neglect 
of socio/pol i ti cal and self-interest 
variables in decision-making. Stubbins 
(1982) felt a reason for this is that 
students are indoctrinated with the 
belief that institutional goals are 
compatible with helping roles. They 
then expect to meet disabled individuals 
in a social context free of the influence 
of political-organizational pressures. 

Rappaport (1977) has observed 
that science and scientist are affected 
by social forces mediated through 
personal values and beliefs. As a 
consequence, the collection of supposedly 
empirical facts as well as their appli- 
cation are directly influenced by 
culture and values. The emergence 
of rehabilitation reflected a variety 
of trends. Initial emphasis on services 
for World War I veterans was extended 
to civilians followed by emphasis 
on the blind. Legislation in the 
1970's created the definitions of 
developmental and severe disability. 
The point is to acknowledge the effects 
of the socio- pol i ti cal sphere of influence 
on public social policy. 

The previous discussion dealt 
with pol itical /social influence in 
rehabilitation on a global scale. 
However it is al so found in the assessment 
process . In a qual itative study on 
the vocational evaluation process, 
Murphy and Ursprung (1983) used the 
term 11 pol itics of evaluation" to describe 
the phenomenon that decisions are 
a function of clinical judgement as 
wel 1 as an awareness of the conse- 
quences for one 1 s career and within 
the professional community. The authors 
reached several conclusions including 
that the needs of the agency or pro- 
fessional took precedence over those 
of the clients, the evaluators seemed 
to use a devalued and ill defined 



ideology especially regarding motivation, 
and both clients and staff shared 
the same conceptions of their respective 
roles . The former were to cooperate 
in a predefined manner whil e the 
1 atter mai ntained control through 
interpersonal communication and gate- 
keeping . Two general impl i cations 
raised were that commonly accepted 
terms such as "unmotivated" or "clinical 
decision" should be carefully examined 
and that practiti oners should pay 
attention to the social , economic, 
and professional influence which 
affects decision-making. 

One alternative to in crease 
deci si on-making is the exposure of 
vocational eval uators to the real ity 
of social, political, and personal 
influence on judgement in the rehabili- 
tation process. Desmond (1982) felt 
such an approach woul d teach professionals 
how these forces could provide rather 
than deny opportunity for individuals 
with disabilities. A partial impetus 
could come from self-help and peer 
groups. Second, vocational evaluators 
must realize that successful divisions, 
resul t from ' satisfaction of as many 
sta kehol ders as possi bl e . Third , 
eval uators and di sabled individuals 
must learn how to use the socio-pol itical 
process to their advantage. Attainment 
of the previous two goals could be 
facilitated by advocacy training. 

Clinical Attitude 

Stubbi ns (1982) attempted to 
analyze the clinical methods in rehabili- 
tation to reveal their foundation 
in an ideology of individualism. 
He defined "clinical attitude" as 
a predisposition towards a model 
in which individuals come to a clinic 
to be treated on an individual bases 
through testing, i nterviews , and 
treatment plans. The problem with 
the clinical app roach, accord ing 
to Stubbin (1982), is that it ignores 
soci o-ecol ogi cal factors such as 
federal fiscal policies, business 
cycles, disincentives to work, and 
employer prejudice. 
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One effect of the clinical approach 
in vocational evaluation is the reliance 
on job placement as the primary outcome 
of success. Compliance with a single 
norm restricts alternatives and encourages 
poor adjustment. Another consequence 
of the clinical role is that problems 
such as stigma and social exclusion 
might be seen as natural rather than 
a function of socio-ecological factors. 
A final point concerns eval uator/cl ient 
rol es . The eval ua tor is percei ved 
as the all knowing authority figure 
in direct control of the presumably 
dependent and compl iant disabled individual 
who possesses minimal decision-making 
responsibil ity. 

The clinical model can be modified 
through alternative procedures. Vocational 
evaluators have shown the capacity 
for organization by adherence to the 
clinical approach and a preference 
for self-interest. What is needed 
is a change in issues of organization 
from self-interest to client interest. 
Second, evaluators must become aware 
of the various levels of systems such 
as the individual, family, and community 
which affect the interaction between 
a disabled person and the environment. 
Third, evaluators need to become more 
flexible in operationally defining 
assessment goals to avoid stereotyping 
outcomes by expected behavior or employ- 
ment. Fourth, vocational evaluators 
need to relinquish some of their power 
to disabled individuals an offer them 
a greater chance for self-development 
through empowerment. 

Empowerment refers to the creation 
of programs or pol icies which assist 
individuals to acquire and control 
resources which affect thei r 1 i ves 
(Jeger and Slotnick, 1982; Rappaport, 
1978). This method implies present 
competence or future potential based 
on opportunity and it would place 
evaluators in a new role as collaborators 
rather than experts. The best current 
example of this thinking is the emergence 
of Independent Living. This movement 
seeks to first develop personal respon- 
sibility for one's life and second 
to encourage participation in the 



daily life of the community (Cole, 
1979). The unique element is the 
mi nimal rel iance on professional 
ass i stance and the strong rel iance 
on peers. Initial personal success 
in Independent Living concerns can 
serve as a power tactic to demonstrate 
self-confidence leading to the feeling 
of sel f-eff icacy. 

Implications 

The general theme of the following 
impl i ca t i ons i s the cal 1 for a new 
model of vocational eval uation based 
on the ecological systems perspective. 
One implication for vocational evaluation 
is a redefinition of the purpose 
of the assessment process. The evaluation 
should be an attempt to match the 
individual in the best way with the 
envi ronment based on identification 
of existing skills and a thorough 
system assessment , and devel opment 
of effective coping strategies. 
Second, the eval ua tor woul d now be 
seen more as a collaborator instead 
of an expert with primary consideration 
for client interest over self-interest. 
Third, the graduate training of evaluators 
would require curriculum modification 
regarding definition and application 
of systems theory, development of 
advocacy skills, socio-political 
awareness, and the capacity to recognize 
professional bias. Finally, a change 
in attitude and a new source of power 
woul d evol ve over time . Di sabl ed 
i ndi vi dual s will real ize they have 
power to take control of their lives 
regardless of the setting. Vocational 
eval uators wil 1 real ize their rel uctance 
to acknowledge socio-ecological factors 
contri buted to thei r negative view 
of the disabled as well as constrained 
their professional growth. 

Summary 

This paper was an attempt to 
analyze the process of vocational 
evaluation from an ecological systems 
perspective , discuss the emerging 
4mpl ications , and offer various alter- 
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natives. The integration of an ecological 
systems approach within the vocational 
assessment process suggested three 
issues. First, respect for person-- 
environment fit requires greater use 
of environmental measures. Second, 
practitioners must be cognizant of 
the tendency for blame and the influence 
of the clinical attitude. Third, 
service providers and recipients must 
realize that the mechanics of the 
decision-making process involve a 
constant interaction of social , political , 
economic, and self-interest variables. 

Proposed alternatives were based 
on education. A variety of tactics 
and strategies were described for 
individuals with disabilities and 
vocational evaluators. The overall 
implication of this paper was the 
suggestion of a new model of vocational 
eval uation. 

REFERENCES 

Cole, J. (1979). What's new about 
independent living? Archives of 
Physical Medicine and Rehabili- 
tation , 60, 459-461. 

Desmond R„~[l982). Executive summary 
and commentary on the clinical 
attitude in rehabilitation. In 
J. Stubbin (Ed.), The cl inical 

attitude in rehabilitation: A 

cross cul tural view , [pp. 39-40) . 
New York: World Reha bi 1 i tati on 
Fund. 

Engle, G. (1982). The biopsychosocial 
model and medical education. The 
N ew England Journal o'f Medicine , 
306(13), 802-805. 

Galvin,D. (1983). The cl inical attitude 
in rehabil itation andalternatives...a 
reaction. In D. Woods, A. Wolf, 
& D. Brubaker (Eds.), The Clinical 
Model in Rehabil itation and Alternatives 
(pp. 39-43). New York: World 
Rehabilitation Fund, Inc. 

Gellman, W. (1968). The principles 
of vocational evaluation. Rehabil i- 
tation Literature , 29(4), 98-102. 

Jeger, A. & Slotnick, R. (1982). 
Community mental health. In A. Jeger 
and R. Slotnick (Eds.), Community 



Me ntal Health and Behavioral-Ecology 
(pp. 7-24) , New York: Plenum 
Press . 

McGrowan, J. (1969). Referral, evalu- 
ation, and treatment. In D. Malikin 
and H. Rusalem (Eds.), Vocational 
rehabilitation of the disabled: 
An overview (pp. 111-128) , New 
York: New York University Press. 

Murphy, S. and Ursprung, A. (1983). 
The politics of vocational eval- 
uation: A qualitative study. 
Rehabilitation Literature , 44(1-2), 
p. 2-12. 

Rap pa port , J. ( 1977 ) . Community 
Psychol ogy . New York: Holt, 
Rinehart, and Winston. 

Rappaport, J. (1981). In praise 
of paradix: A social policy of 
empowerment over prevention. 
Ameri can Journal of Community 
Psychology , 9(1), 1-21. 

Ryan, W. (1976) . Blaming the Victim . 
New York: Vintage Press"". 

Schleser, R. and Rodick, D. (1982). 
A comparison of traditional family 
therapy models and the family 
ecological systems approach. 
In S. Henggeler (Ed.), Deliquency 
and adolescent psychopathol ogy 
(pp. 11- 26), Boston: John Wright. 

Seidman, E. (1983) . Unexamined premises 
of social problems solving. In 
E . Sei dman ( Ed . ) , Handbook of 
Social Interventi on (pp. 46-67), 
Beverly Hills: Sage Publ ications . 

Stubbins, J. (1982). The clinical 
atti tude in reha bi 1 i tati on : A 
cross cul tural view . New York: 
World Rehabilitation Fund. 

Stubbins, J. (1983). The clinical 
model in vocational rehabilitation. 
In D. Woods, A. Wolf, & D. Brubaker 
(Eds.), The Clinical Model in 
Rehabilitation and Alternatives 
(pp. 9-201). New York: World 
Rehabilitation Fund, Inc. 

Tenth Institute on Reha bi 1 i tati on 
Servi ces . (1972) . Vocation al 
evaluation and work adjustment 
services in rehabilitation . Minne- 
apol is . 

Van Bertalanffy, L. (1968). General 



218 



Systems Theory . New York: George 
Braziller. 

Authors 

Gary Szymula 

Department of Psychology 
Illinois Institute of Technology 
Chicago, IL 60616 

Robert Schleser 
Department of Psychology 
Illinois Institute of Technology 
Chicago, IL 60616 



206 



9 

EMC 



219 



NEW DIRECTIONS FOR VOCATIONAL ASSESSMENT: 
EXPANDING THE USE OF SELF-EVALUATION 
AND WORK CLIMATES 



LANCE OHEN HASTIN6S 



ABSTRACT: Two criticisms of current 
approaches to vocati onal assessment 
are that they (a) 1 imit workers 1 involve- 
ment in the evaluation process and 
(b) measure work behaviors without 
regard to work climates in which they 
occur. Research has shown that work- 
related behaviors are directly affected 
by changes in the work cl imate. Moreover, 
self -monitoring facil itates behavior 
change. This paper outlines procedures 
for using videotape and discussion 
sessions to assist handicapped adolescents 
to evaluate the appropriateness of 
their work behavic s within specific 
work climates. Benefits include worker 
insight into some reasons behind their 
behaviors and easier transition from 
vocational training programs to actual 
em pi oyment. 



Profess ionals in the fields 
of vocational evaluation and work 
adjustment have long contended that 
the failure of handicapped workers 
to maintain gainful employment is 
often a consequence of inappropriate 
work habits rather than an inability 
to carry out the technical requirements 
of a job (Kolstoe, 1961; Michael -Smith , 
1950). The literature is replete 
with strategies for measuring critical 
work habits (Sawyer & Morgan, 1981; 
Wri ght , 1980) , but two weaknesses 
are inherent in many of these approaches. 

One cri ti ci sm stems from the 
fact that a worker's work habits 
are usually evaluated by someone 
other than the worker. This practice 
subsequentl y mi nimi zes the extent 
to which a worker assumes personal 
res pons ibil ity for modifying those 
behaviors deemed inappropriate for 
a particular work setting. To get 
around this probl em , Workers have 
sometimes been taught to chart their 
own behaviors, the effects of which 
have been praised by a number of 
investigators (Kelly et al . , 1983; 
Litrownik & Freitas, 1980). Another 
approach to monitoring behavior has 
gained popularity, namely videotaping, 
and results of using it also have 
been encouraging (Booth & Fairbank, 
1983; DeRoo & Haralson, 1971). 

A second criticism of many types 
of vocational assessment is that 
work behaviors are often little oppor- 
tunity for the worker to observe 
and evaluate his/her behavior across 
a wi de gamut of working conditions . 
Research has indicated that a worker's 
behaviors are influenced by the task 
and the physical aspects of the work 
setting (Lustig, 1970). Yet, work 
habits are also affected by employer 
styles and other aspects of the work 
climate. These include the spatial 
arrangement of workers in the work 
area , communication patterns commonly 
used between the workers and supervisors, 
and the degree of responsibility 
allocated to the workers (Friedlander 
& Greenberg, 1971; Hall & Schneider, 
1973; Litwin & Stringer, 1968; Schein, 



207 



'} \ S 220 



1978). Organizational development 
specialists have emphasized these 
aspects of work climate when helping 
individuals to understand the importance 
of work values, norms, and behaviors 
that may be required for membership 
and advancement within an organization 
(Kaye , 1982; Margerison , 1979; Van 
Maanen, 1975; Wallach, 1983). While 
elements of work climate have been 
addressed in a few rehabilitation 
programs (Gelfand, 1966; Gellman & 
Friedman, 1965), routine use of work 
climate variables has yet to be systema- 
tized and established as a fundamental 
component of vocational assessment. 

The purpose of this paper is 
threefold. First, it describes a 
model of vocational assessment that 
stresses self-monitoring of behavior 
through videotaping and individual/group 
discussion to encourage workers to 
evaluate personal work habits within 
the context of different work climates. 
Second, it presents some impressions 
of handicapped adolescents and pro- 
fessionals who have used the model. 
Third, it addresses some of the reasons 
for the model's success and the signi- 
ficance of using it within various 
disciplines related to vocational 
eval uation. 

Description 

The assessment model herein described 
employs a standard five-step procedure. 
The evaluator initially selects a 
specific work activity that can be 
completed by two to four workers (Step 
1). This activity might be as simple 
as an assembly task or as elaborate 
as a simulated office situation in 
which workers are required to file, 
take dictation, and type reports. 

Once an activity has been chosen, 
the evaluator assumes the role of 
a work supervisor and creates a specific 
work cl imate i n whi ch the acti vity 
is to be conducted (Step 2). The 
evaluator does this by altering the 
s pati al arrangement of the workers , 
the degree of responsibility afforded 
to them, and the communication patterns 



between he/she and the workers (see 
Table 1). 



Table 1 



Dimensions of Work Cllroatea 



Type Worker Degree of Coanunlcatlon 

arrangement responsibility patterns 

Bureaucratic Hlerarchljal Interdependent Channeled 

Tyrannical Isolated Independent Negative 

Supportive Grouped Shared Positive 

Innovative Individual Open Progressive 

Lalsssz Falre Grouped Undifferentiated Sporadic 



If the evaluator chooses to create 
a bureaucrati c cl imate , for exampl e , 
he/she positions the workers in a 
hierarchy. Each worker then is assigned 
a tas k which can only be compl eted 
after one worker has received input 
from another worker. Feedback to 
the workers in initiated only be 
the eval ua tor /work supervisor, and 
it is channeled in only one direction, 
i.e. down through the ranks. 

While the workers and the evaluator 
are involved in the work activity, 
their behaviors are videotaped using 
standard video equipment (Step 3). 
It is ideal to have a cameraman film 
the wor k sessions , but satisfactory 
resul ts have been obtained by using 
a stati on a ry camera posi ti oned so 
that all parti ci pants can be seen 
at the same time. 

Work sessions usually last fifteen 
to twenty minutes. At their completion 
the workers view the videotape and 
note specific instances in which 
they demonstrated appropriate and/or 
inappropriate work habits (Step 4). 
Data sheets listing various work 
behaviors provi de the worker with 
a profile of his/her work performance. 
They also facil itate his/her understanding 
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of the appropriate work habits for 
the specified work climate within 
which he/she was working. 

After viewing the videotape and 
noting his/her work behaviors, each 
worker participates in an individual 
or group discussion session moderated 
by the evaluator (Step 5) . The objective 
of this session is to assist each 
worker in examining details of his/her 
behavior and the underlying feelings 
which accompany them. Questions such 
as the foil owi ng are as ked . "How 
well did you follow the instructions 
of your supervisor?" "What exactly 
did you say when your supervisor told 
you to speed up your work?" How did 
you feel when your supervisor criticized 
you?" 

These procedures help each worker 
to understand his/her reactions to 
the work climate and in turn to identify 
specific behaviors that might be changed 
if conflict is to be avoided. As 
the worker is presented with additional 
opportunities to experience different 
work climates, he/she begins to acquire 
a repertoire of behaviors that can 
be used as alternatives to inappropriate 
ones that he/she might be initially 
inclined to use in a given situation. 
In short, this self-evaluation of 
a worker's vocational behaviors and 
subsequent adaptation to various work 
environments gradually evolved into 
an on-going, interactional process 
of work adjustment. 

Impressions 

This model was used as part of 
a vocati onal assessment battery with 
developmental ly handicapped adolescents 
prior to their entry into vocational 
special needs programs in public high 
schools and vocational schools in 
Northern and Southeastern Ohio. Feedback 
from these students and their evaluators 
reveal ed by- products of using this 
model besides obtaining profiles of 
the Students' work behaviors. 

The students commented on the 
value of using video to see the effect 
of their behaviors on co-workers. 



Moreover, both the workers and their 
evaluators reported that the discussion 
sessions enabled them to set aside 
time to examine the students 1 underlying 
needs associated with their overt 
behaviors . The importance of this 
sharing of experience has been emphasized 
by mental health special ist such 
as Bass (1967) and Raymond (1975). 

Workers stated that the model 
also enabled them to focus on behaviors 
that needed to be changed and to 
pace themsel ves when deal ing wi th 
increasingly complex problems. This 
approach is consistent with that 
stressed by Gellman and Friedman 
(1965) who warned against placing 
workers in stressful situations before 
they could handle them. 

Discussion 

To date the efficacy of this 
model has been measured through (a) 
i nter views with handicapped students 
and vocational special needs personnel, 
and (b) direct observations of the 
students 1 increasing ability to demon- 
strate al ternati ve and a p propria te 
behaviors in contrived and actual 
work settings . The apparent success 
of this model thus far may be due 
in part to its uniqueness , and yet 
it would seem that this feature in 
and of itself does not explain the 
improvement that has been noticed 
in some students 1 overall ability 
to cope with work-related stress. 

Haas (1949) maintained that 
instead of teaching individuals to 
avoid conflict, we should teach them 
to make conflict work. Most strategies 
for teaching individuals to cope 
wi th stress either have rel ied upon 
collaboration between the organization 
and the workers (Crowfoot & Chesler, 
1982) or required the worker to engage 
in activities that removed him/her 
either mentally or physically from 
the stressful environment (Newman 
& Beehr, 1979). If the results of 
research which has eval uated the 
effectiveness of using self-monitoring 
techniques can be appl ied to stress 
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reduction in work-related settings, 
then it would seem that this model 
has attained a relative measure of 
success due to its emphasis on an 
active and personal involvement of 
the worker in every step of the vocational 
evaluation and adjustment process. 
Ultimately this in turn may lead to 
improvement in a worker 1 s decision-making 
(Payne, 1983); performance (Clark, 
1982); and psychological, physical, 
and interpersonal qualities of life 
in general (Osipow,. 1979). 

Future research using the procedures 
and materials outline in this paper 
will undoubtedly shed additional light 
on the utility of this model for various 
types of professional involved with 
vocational evaluation. It is safe 
to say at this time, however, that 
information gathered through this 
approach can be of use in writing 
vocational goals for individualized 
education and rehabilitation programs, 
in examining a worker's disruptive 
behaviors within the context of a 
planned activity, and in monitoring 
changes in both the frequency and 
quality of a worker's work habits. 
At the very least, this model can 
facilitate a worker's transition from 
the protected atmosphere of a vocational 
training program to the complex demands 
of actual employment (Neff, 1971). 
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CAREER/ VOCATIONAL ASSESSMENT IN THE 
PUBLIC SCHOOL SETTING: THE POSITION 
OF THE DIVISION ON CAREER DEVELOPMENT 



PATRICIA L. SITLINGTGN 
DONN E. BROLIN 
GARY M. CLARK 
JOHN M. VACANTI 



ABSTRACT: The area of career/vocational 
assessment is one of critical importance 
to the preparation of handicapped 
individuals for productive roles as 
citizens and workers. The purpose 
of this paper is to present the position 
of the Division on Career Development 
(DCD) of the Council for Exceptional 
Children. This paper was prepared 
by members of the DCD Committee on 
Career/Vocational Assessment and endorsed 
by the Executive Committee of the 
division. The following areas will 
be discussed: 

(a) the definition, purpose, and goals 
of career/ vocational assessment; (b) 
the assessment process and methods 
utilized in this process; and (c) 
the personnel involved in the assessment 
process. 



Definition, Purpose, and Goals of 
Career/Vocational Assessment 

The establ ishment of an opera- 
tional definition and purpose of 
assessment is basi c to the other 
issues to be discussed in this paper 
since it determines to a great extent 
the methods and process to be used 
and the personnel to be i nvol ved 
in the assessment process. DCD recommends 
the use of the term "Career assessment" 
to def i ne a devel opmental process 
beginning at the elementary level 
and conti nuing through adul thood . 
Career assessment is a broad term 
that incl udes "vocational assessment" 
or "vocational e val uation ," much 
as career education encompasses vocational 
education. The career assessment 
process is one which should be integrally 
related to all aspects of career 
education, including not only preparation 
for employment, but also preparation 
for the roles of productive family 
member, citizen, and parti ci pant 
in leisure, recreational , and advocational 
acti vi ti es that are of benef i t to 
onesel f and/or others . The specific 
content to be assessed in the career 
assessment process should be dictated 
by the components of the career education 
model being implemented. 

The career assessment process 
should be viewed as a foundation 
for i ndi vi dual i zed program pi anning 
from kindergarten through adul thood. 
The goal s of this assessment process 
s houl d be s peci f ical ly geared to 
pro vi di ng the i n formation needed 
to make decisions in all areas of 
career education programming; these 
dec i sions in all areas of career 
education programming; these decisions 
may be related to developing an individ- 
ual i zed program (curricul urn content) 
for the handicapped learner or determining 
what ass i stance the 1 earner needs 
to succeed in an ongoi ng program. 
The results of the assessment process 
s houl d be fully integrated into -the 
I ndi vi dual i zed Education Plan (IEP) 
or other program plan for the individual . 



212 



?■< 225 



The career assessment process 
should have the following specific 
goals: (A) to assess the individual's 
interests, strengths, and needs that 
relate to his/her future roles as 
a family member, citizen, worker, 
and participant in leisure, recre- 
ational , and avocational activities; 

(b) to assess an individual's ability 
to learn and profit from instruction 
and the best methods for this instruction; 

(c) to provide data for determining 
the best placement within a specific 
career/vocational program; and (d) 
to determine the best placement alter- 
natives for the individual at the 
conclusion of specific training program. 

Process and Methods 

The Division on Career Development 
advocates for the view that career 
assessment is a continuous process 
that is integrally related to the 
ongoing instructional program for 
the handicapped learner. This process 
should begin in the elementary grades 
and continue through adulthood as 
long as divisions are being made relative 
to the career preparation on the handi- 
capped individual . 

DCD does not endorse any specific 
model or location for implementing 
the career assessment process. Whether 
it be done in the classroom setting 
or in vocational assessment center 
or mobile assessment laboratory, the 
results can be equally valid. DCD 
does, however, emphasize the need 
to determine the types of information 
to be collected based on the decisions 
that will be made in terms of the 
1 i f e-1 ong career de vel opment of the 
handicapped individual. DCD also 
emphasizes the need to relate the 
assessment process to the current 
preparation needs of the individual . 
The assessment sequence should be 
paral 1 el to the career programmi ng 
sequence developed for each individual 
and should provide the information 
needed to make decisions in this program. 

DCD does not advocate specific 
methods for obtaining assessment infor- 



mation but endorses the following 
concepts in the selection of methods 
and instruments. First, the selection 
of assessment methods should be specifi- 
cally tailored to the types of information 
that need to be gathered and the 
decisions to be made. Second, specific 
instruments should be selected in 
light of the learning characteristics 
of the individual to be assessed. 
Third, the assessment program should 
utilize methods and instruments that 
i nvol ve tas ks that cl osely resembl e 
the tasks to be trained. Fourth, 
the assessment should be conducted 
in an environment that resembles 
as cl os el y as possi bl e the target 
em pi oyment environment and/or 1 iving 
environment of the handicapped indivi- 
dual. Finally, the assessment process 
should incorporate a sequence of 
assessment extended period of time. 

Personnel in the Career/Vocational 
Assessment Process 

Personnel issues in career/ 
vocational assessment are exceedingly 
complex. Not only do the issues 
in vocational assessment for school- 
aged youth still exist, but the downward 
extension of age and grade "i e v el 
and expansion of the concept to "career 
assessment" also pose additional 
problems that demand attention from 
professionals in the area. 

DCD advocates that the personnel 
responsible for conducting and coordi- 
nating career assessment should be 
certified in special education when 
wor ki ng at the el ementary 1 evel and 
certified in secondary special education 
and/or vocational special needs education 
when working at the secondary level. 
Vocational special needs and rehabili- 
tation personnel should assume primary 
responsibility at the post secondary 
level. This does not meat that cou- 
nsel ors , school psychol og8sts , rehabil i- 
tation personnel , other teachers 
and support personnel, administrators, 
parents, and employers should not 
be invol ved in the process . It does 
mean, however, that the role of coord- 
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inating the career assessment process 
should be restricted to the professional 
primarily res pons i ble advocate (s) 
for the learner's career development 
at nay particular stage in the educational 
process. 

DCD al so advocates that the pro- 
fessionals responsible for coordi- 
nating the career assessment process 
at the elementary level should have 
background in the areas of career 
development and informal assessment. 
The professionals responsible for 
conducti ng the career assessment at 
the secondary and post-secondary level 
shoul d demonstrate background/training 
that meets the minimal standards of 
preparation in the area of vocational 
evaluation. DCD recommends that such 
preparation be based on demonstrated 
competency or successful completion 
of training in competencies such as 
the following: 

(a) analysis of entry level compe- 
tencies needed in the career development 
program; 

(b) implementation of job analysis 
procedures; 

(c) identification and selection 
of assessment procedures appropriate 
for students at various age and func- 
tioning levels; 

(d) selection and administration 
of appropriate assessment instruments; 

(e) construction of rating instru- 
ments for situational assessment and 
other behavior observations related 
to all career roles; 

(f) integration and interpretation 
of assessment data; 

(g) application of assessment 
data to instructional programs within 
the school setting. 

DCD rei terates its commitment 
to work closely with vocational education, 
rehabilitation and school psychology 
personnel to integrate standards for 
public school personnel who are coordi- 
nating the career assessment process 
into those developed by the Commission 
on Certification of Work Adjustment 
and vocational Evaluation Specialists 
(CCWAVES). 
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Summary 

Jn summary the Division on Career 
Development defines career assessment 
as a developmental process which 
begi ns at the el ementary level and 
continues throughout adulthood. 
This process, which includes the 
concept of "vocational assessment" 
(or "vocational evaluation"), should 
be integrally related to all aspects 
of career education, including not 
only preparation for em pi oyment , 
but also preparation for the rol es 
of a productive family member , citizen, 
and participant in leisure, recreational , 
and avocational activities that are 
of benefit to onesel f and/or others . 
DCD does not advocate a specific 
model, setting, or methods for imple- 
menting career assessment, but emphasizes 
that the career assessment process 
should be an ongoing sequence designed 
to parallel the career programming 
sequence developed for each individual 
and should provide the information 
needed to make decisions in this 
program. 
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LEVELS OF WORKER FUNCTIONS CLAIMED 
BY VALPAR FOR ITS WORK SAMPLES COMPARED 
TO THOSE DETERMINED THROUGH JOB ANALYSIS 
OF THE WORK SAMPLES 



JAMES C. CLARK 



ABSTRACT: Work samples constitute 
an important part of many vocational 
evaluations. The use of many commercial 
systems including Valpar, has expanded 
to a variety of settings outside the 
tradi ti onal rehabi 1 i tat ion center 
or sheltered workshop. For example, 
they are now being used in educational 
institutions, hospitals, and private 
evaluation units. Work vocational 
factors, either specific jobs, specific 
traits or clusters of traits. This 
study examines some aspects of the 
vocational basis of the Valpar Component 
Work Sample Series. 

Each of the Valpar work samples 
states that it was developed in in 
relationship to job requirements and 
worker trade arrangement data in the 
Dictionary of Occupational Titles. 
Most of the work sample manuals state 
that the work sample is related to 
and apparently measures the client's 
ability to work with data, people, 
or things at a given level. This 
study examines this contenti on . by 
comparing how closely the recommendations 
of data, people, or things level that 
Valpar claims for each work sample 
correspond with the actual level of 
data, people or things that the work 
samples measure and determined through 
job analysis. 

Job analysis, using the standard- 
ized procedures and definitions contained 
in the Handbook for Analyzing Jobs 
was conducted on each of the sixteen 
Valpar Work Samples. The complete 
schedule was completed for each to 



data, people or things. The values 
for worker functions as determined 
through job analysis were than compared 
with the worker functions claimed 
for each work sample by Valpar. 

Agreement between the two sources 
of worker functions levels varies 
widely among the various work samples. 
Work Sampl e Fifteen is the only one 
where the highest DPT levels completely 
match . In all the others , at 1 east 
one of the others given by the Valpar 
is higher than found by job analysis. 
Work samples Ten, Thirteen, and Sixteen 
are close to each other on most values. 
For the other work sampl es , the two 
measures vary more the Val par Work 
Sampl es are not i nvol ved with peopl e 
above the eight or taking instructions 
1 evel . 

The gi ven vocational basi s of 
the Val par Work Sampl es is not val idated 
by this study. Most of the work 
samples do not appear to measure 
the complexity of worker functions 
that Val par maintains . The specific 
job recomrendations that accompany 
most work samples are also in question. 
In the case of Valpar and probably 
for evaluation in general at present, 
hardware will not substitute for 
the professional competence of the 
eval uator . The skillful eval uator 
can definitely determine whether 
a client is likely to be able to 
perform at hi gher worker functions 
than those claimed in the Valpar 
work Samples by observing and analyzing 
the client while he takes the work 
samples. 

Further research definitely 
needs to be done on the vocational 
basis of the Valpar Work Samples. 
The eval uator who uses the work sample 
system definitely needs to have a 
valid basis for making vocational 
recommendations . The one presented 
by Valpar does not appear to be valid 
in most cases for the aspects that 
have been examined in this study. 

Work sampl es constitute an important 
part of many vocational eval uations . 
Thei r purpose is usually stated to 
be either the assessing of abilities 
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in one or a cluster of traits that 
are vocationally significant or the 
assessment of individual for success 
in a given job. Relating work samples 
to jobs and vocational information 
found in the Dictionar y of Occupational 
Titles (DOT) (1977). This study examines 
selected vocational aspects of one 
major work sample system, the Valpar 
Component Work Sample Series. 

Each of the 16 Valpar Work samples 
states that it was developed in relation- 
ship to the job requirements and worker 
trait arrangement data in the DOT 
(1965). Most work sample manuals 
state that work samples are related 
to and apparently measure client ability 
to work with data, people, or things 
at a given level. This study will 
examine this contention. 

Statement of Problem 

This study seeks to examine how 
closely Valpar work sample claims 
regarding or things correspond with 
the levels of data, people, or things, 
determined through job analysi s associated 
with the work samples determined through 
job analysis. 



Definition of Terms 

The DOT (1977) lists and describes 
12,099 occupational titles, each assigned 
a ni ne di gi t code . The first three 
digits identify the occupational cate- 
gories, divisions, and groups into 
which specific titles are assigned. 
The last three digits identify the 
frequency of the titles, in alphabetical 
order , whi ch have the same f i rst si x 
digits. The middle three digits identify 
the relationship that the title has 
to data, people, and things (DPT). 
The lower a DPT digit is, the more 
complex is the functioning of the 
occupational title for the particular 
attribute. Each level of a DPT digit 
is assumed to potentially include 
all the functions in the particular 
category for each of the lower levels. 
See the Handbook for Analyzing Jobs 



(1972) for more information about 
the DPT concept. 

Job analysis is a systematic 
procedure as defined by the U.S. Depart- 
ment of Labor to identify, classify, 
and record the significant character- 
istics of an individual job. These 
factors include: Worker functions 
(DPT) , descri ption of tasks , general 
educational devel opment , speci f ic 
vocational preparation , aptitudes, 
temperaments, interests, physical 
demands , envi ronmental condi tions , 
and the like. (U.S. Labor Dept., 
1972). 

Review of the Relevant Literature 

The only materials directly 
related to the DPT structure of the 
Valpar work samples are the manuals 
that have been publ i shed for each 
work sample. Each manual contains 
a description of the occupationally 
significant characteristics that 
the work sample is supposed to measure, 
i.e. the type of jobs or physical 
capacities that are directly related 
to the work sample. Valpar maintains 
that the job characteristics it details 
for each work sample are derived 
from the DOT (1965 ) but does not 
explain how this information was 
deri ved or gi ve speci fic rational e 
for its i ncl us ion . Most manual s 
say that the work sample best relates 
to jobs dealing with data, people, 
or things at a given DPT level. 
Certai n work sampl es (numbers 4, 
9, and 14) are said to measure physical 
factors or other speci fic attri butes 
from the DOT (1965), such as preference 
for dealing with people. These work 
samples are said to not be as closoly 
tied to DPT functions as the others. 
Most manuals also give a description 
of work performed and worker require- 
ments of jobs that are said to be 
closely related to the work sampl e. 
Examples of specific occupations 
that are said to be primarily related 
to the work sample and related worker 
tra it groups are usual ly given for 
each work sample. 
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The reader is referred to Botterbusch 
(1980) pp. 74-78 for a general assessment 
of Valpar work samples, and to the 
various Valpar manuals for detailed 
information about the administration 
of the work samples. 

Data Analysis Technique 

Using the standardized procedures 
and definitions contained in the Handbook 
for Analyzing Jobs (1972) job analysis 
was conducted on each of the 16 Valpar 
Work Samples. The complete schedule 
was completed, but this presentation 
will only consider worker functions 
- relationship to data, people and 
things. The job analysis was accomplished 
using a combination of the author's 
personal knowledge about the work 
sample procedures and the instructions 
contained in the work sample manual, 
a client was not observed performing 
the actual work sample, but the author 
has several years experience in admini- 
stering the Valpar work samples and 
is thoroughly familiar with their 
operation. 

Due to space limitations, only 
two of the valpar work samples will 
be considered in detail, number 1 
and 10. first, the operation involved 
in each work sample will be summarized. 
Then, the level of worker functions 
(DPT) claimed by Valpar will be compared 
to the levels determined by job analysis. 
It should be noted that Valpar ex esses 
DPT in terms of the classification 
used for third edition of the DOT. 
For this analysis, the DPT codes have 
been converted to that used in the 
fourth edition of the DOT. 



Data Analysis 



Valpar Work Sample #1 - Small Tools 
(Mechanical ) 



The manual of this work sample 
states that it measures a person's 
understanding of, and ability to work 



with, small tool s. It is al so said 
simulate many of the awkward working 
situations facing a person using 
small tools on the job (Valpar, 1974, 
P. 1., a). 

In this work sampl e , the cl ient 
uses screw drivers, pliers, nut drivers 
and wrenches to assembl e and remove 
screws , hi tchpins , nuts , bol ts , washers , 
and the 1 i ke attached to the sides 
of a hinged, five-sided work box 
with a hoi e in front for the cl ient 
to work through, the work box is 
closed for assembly and opened for 
disassembly, assembly is accomplished 
in sections r The eval uator gives 
the client detailed instructions 
about the hand tools to be used for 
each section, the parts to be assembled, 
and the arrangement that the parts 
will assume. The client is also 
provided with a diagram which shows , 
section by section, the same information. 
After the client has assembl ed al 1 
of the parts , he is required to disassem- 
bl e the parts using the correct hand 
tools. The s 

client again has the diagram for 
a guide. 

Valpar maintains that this work 
sample best relates to jobs dealing 
with ''data" and "things' 1 at the 281, 
381 , 681 , and 684 levels (Valpar, 
1974, p. 2., a). 

"Data" is determi ned by job 
analysis to be at the 6 or Comparing 
level . The client is only required 
to deal with readily observable character- 
i sties. The client can compare the 
hand tool s and arrangement of parts 
pictured on the diagram with that 
in his assembly, there is also an 
example of each correctly completed 
assembly , except for one of the sections , 
in the work box. For the disassembly 
section, the client can again compare 
the hand tools on the diagram for 
each section with those that are 
chosen for disassembly. 

"People 11 is determined by job 
analysis to be at the 8 or Taking 
Instructions-Hel ping level . Almost 
all of the work sample has to "people 11 
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is that the client is required to 
take instructions from the evaluator 
to accomplish the proper procedure. 

"Things" is at the 4 or Manipu- 
lating level. The client js required 
to use a variety of hand tools in 
this work sample and has to exercise 
some latitude for judgement in regard 
to the precision attained. The client, 
however, can readily do this by consulting 
the diagrams and examples that are 
provided, and a higher level for "things" 
does not appear to be justified. 

The author agrees that this work 
sample does require dexterous use 
of hand tools, but does not see how 
it could be considered as measuring 
higher than 6 for "data" and 4 for 
"things". The author does think that 
this is a useful work sampl e for assessing 
physical aptitudes such ; motor coordi- 
nation, manual dexterity, and finger 
dexterity , and that this is what 
should be looked for in work sample 
performance rather than the ability 
to work with "data" or "things" at 
higher levels than stated previously. 



Valpar Work Sample #10 - Tri-leve 
Measurement 



This work sample is said by the 
manual to measure a client's ability 
to perform very simple to very precise 
inspection and measurement tasks and 
to evaluate a clients decision making 
abil ity (Valpar, 1974 , p. 1. , b). 
This work sample is said to best relate 
to those jobs dealing with "data" 
and "things" at the 280, 281, 381, 
687, 681, 682, 684, 685, and 686 levels 
(Valpar, 1974, P. 2., b). 

For this work sample, the client 
is working with a series of metal 
pieces that were tooled on an automatic 
lathe. The client is to follow a 
precise series of inspection steps 
that are explained by the evaluator 
and outlined on a series of diagrams. 
The inspection progresses from visual 
to using various jigs, a ruler, micro- 
meter, and venier caliper to determine 
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if the pieces meet certain precise 
standards. If at any point during 
the inspection a piece does not meet 
the standard, it is deposited in 
a box labeled for that error. There 
are nine separate inspection tasks 
in the work sample. The client is 
first given detailed instructions 
including description of the use 
of various measuring devices. The 
cl ient is then gi ven a chance to 
practice the procedure using a series 
of metal pieces that include examples 
of all the errors. After the practice 
section , the eval uator poi nts out 
any errors that were made. The client 
then does the main part of the work 
sample. 

Job analysis shows that this 
work sample requires the use of "data" 
at the 2 or Analyzing level. The 
client is required to be constantly 
examining and evaluating data and 
dealing with this data on a rather 
complicated level which requires 
the taki ng of al ternati ve actions 
depending upon perception of the 
data. 

For this work sample, the client 
is again required to deal with "people" 
at the 8 or Taking Instructions-Helping 
level. The client is required to 
fol 1 ow i nstructions gi ven by the 
eval uator. 

In this work sample, the client 
deals with "things" at the 1 or Precision 
Working level. The client is required 
to use compl icated and precise measuring 
devices, such as t'ne micrometer and 
venier caliper. Adjustment of these 
tools is essentially tip to the client 
and requires the exercise of consid- 
erable judgement. 

The worker function 1 evels in 
thi s work sampl e as mai ntai ned by 
Valpar are close to those determined 
by job analysis. Both agree that 
the work sample will measure "data" 
at the 2 or analyzing level. Valpar 
says that it will measure "things" 
at the 0 or Setting-up level but 
job analysis found components up 
to the 1 or Precision Wo. king level. 
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Summary and Conclusions 



valid in most cases for the aspects 
that have been examined in this study. 



Table 1 summari zes the results 
of the analysis. Worker function 
levels obtained from job analysis 
are contrasted with those presented 
by Valpar. The agreement between 
the two sources varies widely among 
the various work samples. Work sample 
#15 is the only one where the highest 
levels completely match. In all the 
others, at least one of the levels 
given by #16 are close to each other 
on most val 'ies. For the other work 
samples, the two measures vary more 
widely. It should especially be noted 
that except for work sample #14, the 
Val par work samples are not invol ved 
with "people" above the 8 or Taking 
instruction-Helping level. 

The given vocational basis of 
the Valpar work samples "is not validated 
by this study. It is scac^hat difficult 
to assess vocations if pacts of this 
work sample system uecause Valpar 
gives essentially no information as 
to how it was derived other than to 
day that it came from the DOT. Most 
of the work samples do not appear 
to measure the complexity of work 
functions that Valpar maintains. 
The specific job recommendations that 
accompany most work sampl es are, therefore, 
also in question. In the case of 
Valpar and probably for evaluation 
in general at present, hardware will 
not substitute for the professional 
competence of the evaluator. The 
skillful evaluator can definitely 
determine whether a client is likely 
to be able to perform higher worker 
function than those inherent in many 
Val par work samples by observing and 
analyzing the client while he takes 
the work samples. 

Further research definitely needs 
to be done on the vocational basis 
of the Val par work sampl es . The eval uator 
that uses the work sample system needs 
to have a valid basis for making vocational 
recommendations „ The one presented 
by Valpar does not appear to be completely 



eric 



Appendix 







LIST 


OF VALPAR WORK SAMPLES 


Work 


Sample 


/M- 


Small Tools (Mechanical) 


WoL'k 


Sample 


02- 


Size Discrimination 


Work 


Sample 


03- 


Numerical Sorting 


Work 


Sample 


H- 


Upper Extremity Range of Motion 


Work 


Sample 


05- 


Clerical Comprehension and Aptitude 


Work 


Sample 


//6- 


Independent Problem Solving 


Work 


Sample 


07- 


Multi-Level Sorting 


Work 


Sample 


08- 


Simulated Assembly 


Work 


Sample 


09- 


Whole Body Range of Motion 


Work 


Sample 


010- 


Tri-Level Measurement 


Work 


Sample 


011- 


Eye-Hand-Foot Coordination 


Work 


Sample 


012- 


Soldering and Inspection 


Work 


Sample 


013- 


Money Handling 


Work 


Sample 


014- 


Integrated Peer Performance 


Work 


Sample 


015- 


Electrical Circuitry and Print Reading 


Work 


Sample 


016- 


Drafting 



Tabic I 

Levels of Work Functions Claimed by Valpar for its Work Samples 
Compared to those Determined by Job AnMysls 

By Valpar Prom Job Analysis 



Work Sample Data People Things Iwita People Things 

Number 1 2-8 1* 6 8 4 

3 8 ! 
6 8 0 
6 8 1 
6 8 4 

Number 2 6* 8 4' 6 8 4 

6 8 1 

Number 3 4* 8 4« 6 8 4 

4 8 S 

5 8 4 

5 8 7 

6 8 4 
6 8 S 
6 8 7 

Number 4 N/A 6 8 6 



•Cate£ories that Valpar says are mst closely related vo the worl tnmple. 
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Table 1 (cont.) 



By Valpar 



Work Sample 
Number S 



People TUngs 



From Job Analysis 
Data People Tilings 



Menomonie, Wisconsin: Materials 

Development Center. 
U.S. Labor Department. (1977). 

Dictionary of Occupational Titles, 

4t h e d . Wa s h i n q to n , D . C . : 60 ve rnment 

Printing Office. 
U.S. Labor Department. (1965). Dictionary 

o f Occupational Titles, 3rd ed . 

Washington , D.C. : GPO. 
U.S. Labor Department. (1972). Handbook 

for Analyzing Jobs . Washington, 

D.C: GPO. 
Valpar Corporation. (1974a): Manual 

for Valpar Component Work Sample 

Series: Small Tools (Mechanical) . 

Tucson, Arizona: Valpar Corporation. 
Valpar Corporation. (1974b). Manual 

for Valpar Component Work Sample 

Sen es : Tri- Level Measurement . 

Tucson, Arizona: Valpar Corporation. 

Author 



Number 9 
Number 10 



James C. Clark 
Box 1756 

Brunswick, GA 31521 



Number 14 
Number IS 



Number If 2* 
I 
1 



•Categories th.it Valpar says are most closely related to the work sample. 
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VOCATIONAL OUTCOMES ASSOCIATED WITH 
LOWER EXTREMITY AMPUTATIONS 



SUSAN E. ROUSH 



ABSTRACT: Lower extremity amputation 
is a severe disability that affects 
a person 1 s vocational abilities. 
Limited information is available that 
describes this impact. The vocational, 
amputation, and background histories 
of 31 persons with a lower extremity 
amputation were gathered through a 
structured interview format. The 
results of the interviews were defined 
in terms of vocational status and 
Department of Labor standards on physical 
demands and working conditions. Background 
variables were compared to employment 
status to differentiate between the 
employed and unemployed subjects. 
Pre and postamputation employment 
was compared using the Department 
of Labor standards. Intervention 
strategies for vocational assessment 
and rehabilitation were suggested. 



Amputati on of an extremity has 
1 ong been regarded as a compl icated 
disability because of the numerous 
medical, social, and psychological 
implications associated with the 
loss of a limb. There are an estimated 
311,000 persons in the United States 
with a major extremity amputation 
(Friedman, 1981) and an additional 
43 ,000 i ndi vi duals have amputations 
each year (Banerjee, 1982). Approxi- 
mately 90% of amputations i nvol ve 
the lower extremities and more than 
half of these are the result of vascular 
disease (Friedman, 1981). 

Many factors play a role in 
the effectiveness of ongoing rehabili- 
tation efforts that are available 
for persons with amputations. Success 
and fai 1 ure is f requentl y defined 
in different ways by the many pro- 
fessionals that come in contact with 
persons disabled by an amputation. 
Successful employment in a competitive 
environment, however , is an outcome 
that implies mastery of many of the 
components of a comprehensive rehabili- 
tation effort. 

Personal and social adjustment 
to the loss of a limb, as well as 
a sta bl e medical status are several 
of the important considerations which 
determine success of a rehabilitation 
effort. Much has been written about 
these psychological and social aspects. 
Less has been written about functional 
abilities following amputations and 
even less about how all of these 
factors influence a person's ability 
to parti ci pate i n gai nf ul empl oyment . 
Empl oyabil ity following an amputation 
is directly influenced by physical 
skills of the person involved and 
the corresponding demands of the 
jobs in the available market. Indeed, 
vocational counsel ing, vocational 
i nves ti gati on and retrai ni ng have 
been cited as essential components 
of a rehabilitation program for persons 
with amputations who are of working 
age (Kindon and Pearce, 1982). 

The most significant factor 
related to functional abil i ty is 
the level of the amputation,, This 
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is true for several reasons, including 
the obvious loss of bone and muscle 
tissue, heavy prostheses and alterations 
in body metabolism. Because of these 
considerations mobility, balance and 
endurance are factors that may produce 
limitations on a job. Persons with 
amputati ons are encouraged to avoid 
jobs which require excessive walking, 
constant standing, climbing, crawling, 
kneeling and lifting heavy objects 
(Wright, 1980). The use of a prosthesis 
is al so a source of 1 imitation: prostheses 
are inherently uncomfortable, do not 
allow the enclosed stump to breathe 
and are subject to mechanical malfunc- 
tions . Consequently, extremely cold, 
warm and/or dusty environments are 
suggested em pi oyment pi aces to be 
avoided (Friedman, 1981). 

Little is presently known about 
actual vocational experience of persons 
with amputations. Experience reveals 
that many do not work in sedentary 
or light jobs even with high school 
or college educations. Some work 
in physically demanding jobs as soon 
as they are medically able, even with 
over-riding systemic disease symptoms. 
Experience suggests that present vocational 
assessment and counseling methods 
do not adequately address the comprehensive 
nature of employment of persons with 
amputations. Only when more information 
is available that defines what persons 
with amputations are and are not doing, 
and what differentiates between those 
employed and unemployed, will more 
effective strategies for intervention 
be developed. 

In a recent pilot study an attempt 
was made to define actual vocational 
outcomes of 31 persons with 1 ower 
extremi ty amputations . The subjects 
for this study were persons ir. attendance 
at the University of Mississippi Medical 
Center Amputee Clinic during a six 
week peri od in 1984. Al 1 persons 
attending the clinic between the ages 
of 18 and 64 and demonstrating a lower 
extremity amputation freely consented 
to participate in the study. Background 
data and information related to the 
subjects 1 vocati onal and amputation 



histories were gathered through a 
structured interview format. 

Results 

The median age of the predominantly 
mal e subjects was 39 years (range 
19-63 years) and the median time 
si nee amputation was 3 years (range 
1 month - 36 years). The most common 
cause of the amputation was diabetic 
related disease and the mean education 
level of the subjects was completion 
of the ninth grade. Most of the 
subjects were independent ambul ators 
and most felt that their personal 
desire and motivation was their best 
source of vocational help. 

Twenty-six subjects were employed 
or in school at the time of their 
amputation. The remaining five were 
on disability. At the time of the 
survey six of the subjects were employed 
full time and two part time. An 
additional four were not working 
but had worked since their amputation. 
The remaining 19 subjects had not 
been employed in any way after their 
amputation. 

The relationship between several 
subject variables and employment 
status was examined through the use 
of chi-square statistics. Educational 
level, age, time since and cause 
of amputati on , ambul at ion status 
and perception of vocational assistance 
were the background variables evaluated. 
Because of the limited number of 
subjects in this study (n=31) these 
background variabl es were col lapsed 
to offset the chi-square tendency 
toward observed frequency skewness 
seen when the expected frequencies 
of a distribution are very small. 

Three variables proved to be 
significant factors in separating 
the employed and unemployed subjects: 
ambulation status, time since amputation, 
and vocational assistance. The first 
two factors showed that persons were 
more likely to be employed if they 
were i nde pendent ambul ators (wi th 
or without a cane) and if more than 
30 months had passed since their 
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amputation. Persons were also more 
likely to be employed if they attributed 
their vocational rehabilitation to 
intrinsic factors (personal desire 
and motivation) rather than to external 
factors , such as help from physicians, 
therapists , vocational rehabil itation 
counselors or an understanding employer. 
The cause of the amputation (traumatic 
or non- traumatic) , educational background 
(completion or non-completion of at 
least 10th grade in high school) and 
age (above or below the median of 
39 years) were not significant factors 
in separating the employed and unemployed 
subjects . 

The final aspect of this study 
was a comparison of before and after 
amputation empl oyment . Standardized 
information, available through the 
Department of Labor (DOT, 1977, Handbook 
for Analyzing Jobs, 1977 , & Field 
& Field, 1977) was the basis of this 
comparison. Seven subjects, those 
who were employed before and had worked 
after their amputation, were included 
in this analysis. 

The job characteristics used 
to describe the subjects pre and postampu- 
tation employment included 13 variables. 
These variables and the frequency 
distribution of job ratings are listed 
in Table 1. Only two variables, No.l 



Frequency Distributions of Standardized Job Variables 
Associated With Pre and Postamputatton Employment 



Job Variable 

A. Physical Demands 

1. Strength-Sedentary 
Light 
Medium 
Heavy 
Very Heavy 

2. Climbing and/or balancing 

3. Stooping, kneeling, crawling, crouching 

4. Reaching, handling, fingering, feeling 

5. Talking and/or lr *rlng 

6. Seeing 

B. Working Conditions 



Employment 
Pre Post 



7. 



9. 
10. 
11. 
12. 
13. 



Indoors 
Outdoors 
Doth 

Extremes of cold 
Extremes of heat 
Wet and humid 
Holse and vibration 
Hazards 

Fumes, odors, toxic condlatlons. 
poor ventilation 



(Strength) and No. 7 (In/Outdoors), 
are defined for every job. The remaining 
11 variables are listed for a job 
only if that factor is a significant 
part of that job. 

Two methods were used to compare 
the Strength variable before and 
after amputation. First, the strength 
ca tegori es were ran ked in a 1 to 
5 interval scale (1 = sedentary, 
3 = medium, 5 = very heavy). A t-test 
for nonindependent groups showed 
that the pre and postamputati on employment 
strength means of 3.43 and 2.71, 
res pec ti vely , were not significant. 
The strength categories were also 
ranked in an ordinal scale with values 
corresponding to the minimum strength 
(i n pounds) cited in the definition 
of each category (0 = sedentary, 
10 = light, 20 = medium, 50 = heavy, 
100 = very heavy). A t-test showed 
that the pre and postamputation employment 
strength means of 44 and 20 pounds, 
respecti vely, were not significant. 
Descriptively, four subjects returned 
to a job requiring less strength, 
two did not change strength demands 
and one returned to a job which required 
more strength? 

The remaini ng Physical Demands 
and the Working Conditions were evaluated 
by 1 oo king at how each individual 's 
job changed in terms of an addition 
or a subtraction of an interfering 
or noninterfering variabl e. Physical 
demands No. 2 and No. 3 (climbing 
and/or balancing; and stooping, kneeling, 
crawl ing and crouching) were judged 
to be interfering vocational variables 
for the subjects. The remaining 
Phys i cal Demands (reach ing, etc., 
tal ki ng and/or hearing, and seeing) 
were judged to be non- i nterf eri ng 
vocational variables. All of the 
Working Conditions (except work indoors) 
were judged to be interfering variabl es. 
Postamputation empl oyment di f fered 
from preamputation empl oyment in 
the following ways: three interfering 
and four non-i nterferi ng Phys i cal 
Demand Variables were no longer signi- 
ficant in the post-amputation jobs, 
four noninterfering variables became 
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significant. One interfering Working 
Condition was lost, one was gained. 
Five individuals did not change the 
Indoor/Outdoor/Both rating of their 
job. One subject's job became more 
outdoors oriented, one more indoors 
oriented. Collectively, 60 percent 
of the changes were accommodati ng 
to the amputation, 40 percent were 
not. 

Discussion 

Three variables proved to differen- 
tiate between the employed and unemployed 
subjects in this study. The ability 
to ambulate independently (with or 
without a cane) was a significant 
variable and suggests that mobility 
is a key factor for employment. Of 
course, ambulation status may actually 
be indicative of a more general state 
of health and hence influence employability 
from a broader base. If mobility 
itself is the key however, efforts 
toward increasing accessibility of 
the work place to wheelchairs (and 
increasing wheelchair acceptabil ity 
in employers 1 minds) would be an effective 
intervention to improve return to 
work rates for persons with lower 
extremity amputations. 

Time since amputati on was al so 
a significant factor and suggested 
that as more time passes from an amputation 
(exceeding 30 months) the more likely 
the individual will be employed. 
Thi s resul t is in confl ict with the 
widely held view that the longer an 
individual is out of work, the less 
1 i kely he/she i s to return . There 
were several subjects in this study 
who were interviewed very soon (1 ess 
than 5 months) after their amputation 
and medically may not have been able 
to work at that point in their recovery. 
This influence may have unfairly skewed 
the result of this evaluation. The 
key factor that influenced this return 
to work variable appears to be expec- 
tation . Expectation appears clearly 
rel ated to time and the more time 
that passes from em pi oyment the 1 ess 



the expectation is of returning to 
work. 

The personal perception of source 
of vocational assistance was another 
si gni f icant factor in differentiating 
between the employed and unemployed 
subjects in this study. Those individuals 
who cited intrinsic factors as opposed 
to external agents were more likely 
to be employed. This result is in 
accordance with the growing awareness 
of the 1 i mi tat ions of the medi cal 
model of il 1 ness management. The 
entire issue of employment with a 
severe disability such as an amputation 
is too broad and encompassing to 
be "taken care of" by an extraneous 
force . Unfortunately, most members 
of this society are not taught to 
be res pons i ble for their own heal th. 
Instpad, they are encouraged to allow 
professionals to make the decisions 
and solve the pr obi ems associated 
with their bodies. If this attitude 
holds in light of a severe disability, 
frustration, anger and resentment 
can be the only result. This perspective 
of personal responsi bil ity toward 
care following an amputation holds 
great romise as a counseling tool. 

Assisting an individual to take 
responsibility for their own future 
can provide direction and focus for 
that future. Further research exploring 
the concept of locus of control and 
em pi oyment fol 1 owi ng amputation is 
clearly indicated. 

Age , cause of amputati on , and 
education were not significant variables 
in di f f erenti a ting between empl oyed 
and unemployed subjects in this study. 
This evidence serves as a reminder 
that older, less educated individuals 
do have employment potential and 
should not be si ighted in any type 
of re ha bi 1 i ta ti on program . Thi s 
perception may appear obvious to 
re ha b i 1 i tati on professi onal s , but 
everday practice too often conforms 
to other forces that do not enjoy 
this insight. Efforts need to be 
made to conscienti ousl y apply thi s 
principle in practice. 
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The final aspect of this study 
compared empl oyment characteristics , 
pre and postamputation. The Department 
of Labor provides a vast array of 
standardized information to assist 
with this type of evaluation. The 
nationwide applicability of any results 
using this data makes it a tool of 
great importance . For example, the 
results of this study suggest that 
lifting and carrying abilities are 
not significantly reduced for persons 
with lower extremity amputations. 
Individual differences did show a 
tendency toward engaging in lighter 
work, but a firm cut off for the capacity 
was not suggested. Also, the evaluation 
of the remai ning physical capacities 
and work conditions suggested a similar 
relationship. 

Individual accommodation was 
made toward the amputation but no 
general point of conformity was suggested. 
Undoubtedly, the limited nature of 
this study does not warrant absolute 
guidelines. However, if the physical 
and environmental characteristics 
of jobs that represent successful 
employment for persons with amputations 
can be identified and defined in terms 
compatible with Department of Labor 
data, a more effective vocational 
assessment device will result. Indeed, 
all standardized job information available 
through the Department of Labor, e.g. job 
temperaments and interests, can be 
viewed in this same manner. Much 
research is needed in this area so 
the present tool s of vocational assessment 
can be more fully utilized. 

Stannary 

Lower extremity amputati on is 
a disability that has a definite impact 
on a person's vocational life. This 
study attempted to define that impact 
in terms of change in employment status 
and employment characteristics seen 
with an amputation. Many factors 
appear to be significant including 
ambul at ion status , expectations and 
perception of source of vocational 
assistance. Educational and age did 



not appear to be as important i n 
predicting empl oyabil i ty as might 
be expected . Department of Labor 
stan da rdi zed i nformation was used 
as a tool to evaluate pre and postampu- 
tation empl oyment . This extensive 
tool has not been utilized to its 
f ul 1 est ca pa city as a vocational 
assessment instrument. It has the 
potential to provide valuable information 
about physical capacities and environ- 
mental conditions in the work place. 
Any results or guidelines developed 
using this tool have nationwide appli- 
cabil ity . 

There is a gap between the real ities 
of present vocational rehabil i tat ion 
techniques and the experience of 
havi ng a 1 ower extremity amputation . 
The two are compatible and further 
research is needed to bring them 
together. 
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WORK HARDENING MODEL FOR THE 80 'S 



PATRICIA C. SMITH 
BR'ICE HcFARLANE 



ABSTRACT: A search of the literature 
reveals that work hardening has a 
long hi story as a treatment process 
for the injured and disabled. This 
paper compares and contrasts work 
hardening models and describes a model 
for current practice that draws upon 
the best from the past and meets the 
needs of today. 



Graded (progressively demanding) 
exerci se and to! erance concepts were 
used very early in the treatment 
of tuberculosis patients. Briggs 
(1949) referred to the addition, 
in 1859, of graded exercise and work 
tolerance to the medical regimen 
of good food and fresh air for tuber- 
culosis treatment . Graded exercise 
was introduced first, progressing 
to graded work tolerance in accordance 
with each patient's physical capacity 
as determi ned by thei r physi ci an . 
The graded programs were used as 
a final stage of treatment or to 
accompany long periods of enforced 
bed rest. Exercise took the form 
of walking and "conversational" therapy 
progressi ng to more demanding tasks 
in terms of amount of physical exertion 
and satisfaction of social, vocational 
and economi c needs . Group activity 
in occupational therapy was used 
for its objectives of work tolerance 
as well as social rehabilitation. 
Speci f ic work to! erance tasks such 
as woodworking and various clerical 
tasks were prescribed based upon 
their useful ness in estimating resistance 
to breakdown from physi cal effort 
and emotional upsets. 

In 1924 Kidner wrote about a 
program of "habit training" which 
he defined as development of the 
habits of industry that had been 
impaired by disease or accident. 
Such habits are more commonly referred 
to now as worker characteristics. 

Work hardening appears in the 
psychiatric literature in the 40's 
especially in regards to preparing 
the patient for return to competitive 
life after the sheltered life of 
the hospital ward (Phelan). The 
programs featured real i sti c work 
environments, perhaps using the hospital 
laund ry, barber shop or carpentry 
shop. Patients were observed by 
their physicians duri ng progressively 
demanding work tasks for cooperation 
and friendliness as these were felt 
to be important personal i ty traits 
if the person was to wo^k "harmoniously" 
after discharge. Instruction and 
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training for specific skills were 
frequently undertaken by the manual 
arts therapists during the usually 
lengthy stays. Medical supervision 
was inherent and decisions were made 
at each step by the attending psychiatrist 
or physiatrist. 

• Work hardening programs of the 
40^ for physically handicapped shared 
many of the same goal s and features 
as those for mentally disabled (Thomp- 
son). Work experiences were provided 
whi ch were a representati ve of jobs 
available in the community. Programs 
were designed to make the worker quickly 
aware of the relationship of his work 
hardening program to a job which may 
support his family. While work speed 
was variable quality standards of 
work should not be, warned the author. 
The treating physician determined 
the time for resumption of employment. 
Following work hardening a detailed 
report was prepared by the supervising 
occupational therapist including infor- 
mation on personal ity traits and physical 
1 imitations gl eaned from close acquaintance 
and observation. 

In the 50's Watkins (1959) described 
a program using the non-medical depart- 
ments of Massachusetts General Hospital 
for restoration of physical tolerances. 
Physiatrists directed the program 
of medical evaluation and therapy. 
Occupational therapists directed prevo- 
cational and work therapy with a vocational 
counsel or res pons ibl e for establ ishing 
vocational goals and placement. In 
order to aid evaluation of progress, 
a progressive resistive exercise component 
was added. By measuring increased 
strength in pounds they were able 
to track progress in developing toleran- 
ces. This feature was reported rather 
as an afterthought but documents an 
early effort to objectify and quantify 
the program. 

Wegg wrote in 1957 about moves 
to standardize and objectify the work 
therapy program at May T. Morrison 
Center for Rehabil itation in San Francisco, 
California. She described features 
of the occupational therapist supervised 
program which was designed along the 



1 i nes of the Workmen 1 s Compensation 
Convalescent Centre in Malton, Canada. 
Features of the San Francisco program 
i ncl uded simul at ion of on-the-job 
conditions and tasks for the individual 
patient which were used to estimate 
abil ity and as an exerci se medium 
to develop work habits, confidence, 
increase physical and emotional tolerance, 
improve strength, range of motion , 
coordination and dexterity. Activities 
were graded as to length of time, 
resistances used, distance weights 
were 1 i fted and carri ed , positions 
of work, etc., to maintain and improve 
strength and endurance for a full 
work day. Al 1 referral s were made 
by a physician and the number of 
hours of parti ci pation was prescribed 
by the physician. 

Prior to testing, the vocational 
counsel or , physiatrist, occupational 
therapist and industrial engineer 
drew up a work sample prescri ption 
and schedule for testing. The industrial 
engineer evaluated the finished product 
as to its acceptance by an employer. 
The occupational therapist differentiated 
innate dexterity or mechanical "know 
how 11 from defects in training (of 
prostheti cs for exampl e) or defects 
due to the disability. The occupational 
therapist also judged emotional aspects 
of work performance. 

Reports of performance, recom- 
mendations for assistive equipment, 
therapeutic programs, length of work 
day and actual job classifications 
were made by the occupational therapist 
and industrial engineer. Little 
practical i nf ormation was avail able 
in the literature at the time on 
work testing, work sampling or job 
simulation therefore original tests 
were developed and used. In reporting 
findings several programs were encoun- 
tered when setting up standard procedure 
by which to evaluate individual program 
resul ts . First was the setting of 
a point of reference or "norms." 
Second was the problem of evaluating 
trends in production speed. Third 
was aval ua ting the si gnificance of 
errors. Fourth was the problem of 
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evaluating the worker on the basis 
of subjective observation of the previous 
qual i ties. 

Just three years later, in I960, 
Wegg described the same program but 
with significant changes. Work hardening 
had moved away from the medical model 
toward a vocational model and adherence 
to a scientific approach. A physician's 
prescription was no longer needed. 
Instead a recent physical examination 
or approval of worker participation 
was requi red . Physical conditioning 
and adjustment was seen a? a distinct 
program to follow work evaluation 
since the purpose of hardening was 
to develop work habits or improve 
work assets as noted in the evaluation. 
To attempt. to do both functions simul- 
taneously would lead to loss of the 
scientific approach. 

Ethridge proposed work as a treatment 
media for all disabilities. He described 
a program in a state psychiatric hospital 
which he stressed was applicable to 
any hospital and any occupational 
therapy department. Within the hospital 
environment 205 different work assignments 
were developed. A very popular and 
therapeutic work assignment was cigarette 
rolling! The finished product was 
sold to the patients at a cost much 
lower than commercially available. 
The advantages were obvious in that 
the work was gratifying meaningful, 
real, successful in building tolerances 
and it was motivating for personal 
financial reasons. Each work assignment 
combined these elements in that each 
was real , productive work and not 
merely exercise or diversion. 

A si mi 1 ar emphasis on real work 
was, incorporated into the work therapy 
program at UCLA Neuropsychiatry Institute, 
a short-term private hospital (Poussaint). 
He pointed to the benefits of work, 
persuaded that .hrough work peopl e 
derive their feelings of status, worth, 
satisfaction and sense of fulfillment 
that is of lasting value. Patients 
were referred to the program by psychia- 
trists and assigned and guided by 
the occupational therapy department 
to work tasks in the short stay community 



hospital. Assignments to work therapy 
were as brief as one week with a 
work day of three to eight hours. 
Even the shortest duration assignments 
contributed substantially to recovery 
of patients and return to the community. 

Societal changes in the 70 1 s 
si gnal ed major changes in the work 
force and access to jobs. Opportunities 
to work were, as never before, influenced 
by urbani zati on , technol ogy and education 
(Johnson). These changes in the 
nature and meaning of work necessitated 
changes in the use of work as therapy. 
Jobs once performed by disabled people 
such as collating were, for the most 
part taken over by machi nes . Some 
jobs began to have a limited life 
expectancy. Preparation of disabl ed 
worker thus needed to i n corporate 
the more generic tolerances and use 
transferable skills and the worker 
characteristics necessary for any 
job. 

Diasio and Jones (1970), in 
thei r work with psychiatric cl ients 
also concentrated on devel opment 
of worker characteristics along with 
specific work tolerances. Their 
program sought to foster devel opment 
of new behavior repertoires which 
would bring greater vocational accep- 
tance . They made i t cl ear to thei r 
young adult clients that they were 
engaged in a voluntary collaborative 
relationship to develop these behaviors. 
The program, as in former decades , 
used realistic work settings within 
the hospital and they also moved 
out of the institution to use community 
settings . 

The 1980 f s brought a new sophisti- 
cation to the process of i ncreasing 
a person's work place tolerance. 
The vi ew of man has moved from a 
reduct i oni s ti c , mechanical model 
to one of an integrated whole. This 
was f aci 1 i tated by General Systems 
Theory (Von Bertal anf fy, Simon) and 
the integration of various disciplines 
i nto an i ntegrated network. Man 
was viewed as a system of interconnected 
sub-systems whi ch when integrated 
into a "system" became more than 
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what the parts were separately. Man 
as a system was described in several 
ways (Lawton, Pfsiffer, Paulson, Kielhofner 
and Burke, McFarlane). Kielhofner 
and Burke developed a model of human 
occupation that included input, through- 
put , output , and feedback . The throughput 
was divided into the vol itional subsystem, 
this included the person's goals, 
values, and sense of personal causation, 
the habituation subsystem, which included 
the personal internalized roles and 
habits, and the production subsystem, 
which incl uded the person's skilled 
actions and cognitive abilities. 
This model also included the environment. 
The environment was composed of objects, 
people, and events. The environment 
was both the source of the input as 
well as receiver of the systems output. 

In this model, the system is 
a hierarchy in that the subsystems 
are arranged in an order such that 
the higher subsystem control the lower 
order subsystem, however, the lower 
order subsystems need to operate effec- 
tively for the higher systems to be 
able to exist. In the human occupation 
model, the person's volitional subsystem 
controls their performance subsystem. 
CI inically, this is seen in the individual 
that may have the physical tolerances 
for employment, but is not motivated 
to use their capabilities. Another 
example is the severely involved spinal 
injured cl ient who does not have extensive 
physical capabilities but whose motivation 
enables them to be employable. The 
habituation subsystem is most familiar 
to vocational counselors as the "worker 
traits or worker characteristics" 
of attendance, punctuality, grooming 
and self-care, and worker role behaviors. 
This subsystem maintains the system's 
behavior in routine patterns. Thus, 
the worker must get up at a set time, 
and follow a daily routine to not 
only get to work, but to carry out 
their daily duties once on the job. 
The performance subsystem consi sts 
of skills. The skills are the organized 
component actions that lead to the 
accomplishment of a goal. Skills 
entail both neurological and kinesio- 



logical as well as cognitive areas. 
The performance subsystem produces 
action on the environment; a machinist 
tightening bolts or a salesman writing 
up an order. 

The environment in the model 
consists of objects, people, and 
events . The objects in the work 
hardening environment are usually 
vocational oriented. There are few 
medi cal objects , such as stainl ess 
steel tables, white walls, and stetho- 
scopes. There are work benches, 
secretarial desks and chairs, drafting 
tab! es , and machinery. The people 
in the environment are not dressed 
in white coats. They may be therapists, 
but they have replaced their medical 
cloak for vocational attire. They 
pi ay the joint rol e of therapist 
and supervisor. Coffee breaks, lunch 
breaks, being assigned a new job 
task , and filling out time cards 
are a few of the events that take 
place in the environment. 

Work hardening, using a general 
systems approach, gives the clinician 
a variety of variables to manipulate 
and ex pi ai n a cl ient 1 s performance 
in the hardening setting. The model 
of human occupation tells che clinician 
to observe the client's interactions 
wi th the envi ronment. The cl lent' s 
motivation, habituation, or performance 
subsystems may be hi nderi ng them 
from em pi oyabil ity. Perhaps the 
environment is not supportive of 
the person. This inclusion of the 
envi ronment into the work hardening 
process is exemplified in the growing 
body of literature on "ergonomics." 

Ergonomics , the person-environmental 
f i t i n the workpl ace gi ves the work 
hardening clinician the tool s to 
assess, change, and modify the work 
pi ace . The 1 iterature of the past 
f i ve years has grown si nee it was 
recognized that injuries and costly 
disability claims could be prevented 
by the proper envi ronment- person 
fit (Chaf f i n and Anderson) . The 
adjustment of chairs , desk heights , 
and lifting devices are a few of 
the common applications of ergonomics. 



P4Q 



In the work hardening center, the 
work station is a laboratory in which 
the various elements can be altered 
to obtain the optimum performance. 
An example would be elevating the 
working surface of an el ectronic assembler 
with a platform so that the person 
does not have to lean over the bench 
and strain their back. Arms, legs, 
feet, and hands can be supported. 
Tools can be padded to prevent vibration. 
Chairs can be lowered or raised. 
The person's anthropomorphic dimensions , 
the job's biomechanics, and the work 
station's dimensions are all necessary 
components of a complete work hardening 
assessment and treatment regimen. 

This need to apply diverse disci- 
plines to a common problem, in returning 
the person to work, has led to the 
expansion of the work hardening programs 
to realization as in past decades, 
that a mul t i di sci pi i nary approach 
would be needed. This current mul tidis- 
ciplinary approach was described by 
L. Matheson. Occupational therapists, 
vocational evaluators, physical thera- 
pists, and psychologists are part 
of the work hardening team. The appli- 
cation of the physiological and kines- 
iol ogical backgrounds of the occupational 
and physical therapists, the biomechanical 
approach of the rehabilitation engineer 
are blended with the vocational evaluator 
approach to give the cl ient the necessary 
therapeutic physical capacity program 
with an appropriate vocational focus. 
The psychologist and occupational 
therapist are able to provide insights 
into the client's adjustment, and 
motivation, and enable the use of 
behavioral techniques such as contingency 
reinforcement , behavioral schedules, 
and pain management techniques which 
are incorporated into the work hardening 
program. Thus, the breadth of the 
program and the servi ces a va i 1 abl e 
i ncrease the probabi 1 i ty of success 
for the cl ient . 

The earlier programs operated 
on funds from the State and Federal 
level. As these funds fluctuated 
and were reduced in some cases, the 
feasibility of providing long-term 



programs with expensive staff mandated 
a change. The work hardening programs 
of earl ier decades 'educed staffing. 
They were incorporated into the sheltered 
workshop model . The reemergence 
of the work hardeni ng programs is 
based on the shift to private sector 
funding . The wor ker 1 s compensation 
system and the long-term disability 
systems, not dependent on the political 
pressures of the Federal and State 
tax systems, have been able to support 
the new work hardening models of 
the 1980's. This is also due to 
the short term approach to treatment. 
The i n ten si ve staffing devel ops and 
implements the program on a 3-4 week 
schedul e . Progress i s measured in 
quantitative terms and monitoring 
i s cri ti cal to be abl e to document 
progress. This is important for 
the legal implications in which all 
services in the highly litigated 
area of worker's compensation are 
invol ved . 
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PHYSICAL CAPACITY EVALUATION AND WORK 
HARDENING PROGRAMMING: THE CARLE 
CLINIC ASSOCIATION MODEL 



VIRGIL ROBERT NAY 



ABSTRACT: This paper describes the 
industrial rehabil itation system currently 
housed at Carl e CI inic Association, 
and demonstrates the utility of the 
system 1 s vocational eval uation and 
work hardening/adjustment programs. 



The private- for- profit rehabilitation 
i ndustry has been descri bed as a 
system offering services analogous 
to those provided by state and federal 
systems (Diamond & Petkas , 1979; 
Lewin, Ramseur & Sink, 1979; Organist, 
1979 ) • However, unlike the public 
sector, the private sector service 
del ivery system is placement oriented 
(McMahon , 1979 ) , em p ha si ng short 
term vocational evaluations of trans- 
ferable skills, court testimony, 
coordination of medi cal ser vi ces 
and job pi acement (Diamond & Petkas , 
1979; Lewin et a!., 1979). Matkin 
(1982) concurred that the results 
of his survey of 174 members of the 
National Association of Practitioners 
in the Private Sector (NARPPS) demon- 
strated that the private sector emphasis 
is greatest in areas of vocationally 
oriented evaluation and job placement. 
Such an emphasi s can be expected 
when considering the clientele served 
by the private sector (i .e. , industrially 
i njured , chroni c low back or other 
orthopedic problem) and the objective 
of servi ces offered; to return the 
patient to work in the most expedient 
way while operating within the appropriate 
legal framework (Workman, 1983). 

The private sector is diversified 
in its work settings unique to the 
individual practitioner. For example , 
Workman (1983) not^i the following 
as current v;or k setti ngs reported 
by members of NARPPS: 

1. Cottage Industry: a counselor 
who operates from his or 
her own home or shared office 
space, utilizing an answering 
service for telephone messages 
and a clerical pool for typing 
services , 

2. Regional Firm: A firm with 
as many as 50 counselors 
working in a region or state, 
with one to six offices within 
the region. This setting 
usual ly em pi oys special i zed 
employees , such as job pi acement 
special ists , marketing and 
administration staff. 

3. National Firm: A large corpor- 
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ation with 100 to 1000 pro- 
fessional staff members, operating 
in major areas of the United 
States. 

4. Insurance (in-house) Firm: A 
vocational unit establ ished 
by the insurance company. 

5. Ancillary Firm: Firms that 
pro vi de anci 1 1 ary servi ces , 
such as work evaluations and 
job development services, 
to private rehabilitation 
vendors . 

One setting that has been omitted 
and is unique to the private as well 
as to the public sector is the multi- 
medical facility (i.e., private-non-profit 
hospital or the pri vate-for-profit 
medical clinic). Several hospitals 
and clinics have established rehabili- 
tation programs modeling those in 
the for-profit sector, integrating 
an industrial rehabilitation package 
with the standard medical care system. 

Process 

Carle's industrial rehabil i tation 
concept is predicated on the philosophy 
of vocational evaluation and work 
adjustment services. Lynch (1983) 
described the vocational evaluation 
process as a formal attempt to collect 
occupational information in order 
to describe and predict an individual's 
vocational functioning level. In 
the private sector, this translates 
into determining the degree of 1 imitation 
imposed by an event (work accident), 
and its implications for future vocational 
potential (Sink & King, 1983) . Techniques 
employed to determine this degree 
of limitation usually involve a) inter- 
viewing, b) psychometric testing, 
c) work samples, d) situational assessment, 
e) job sample (site) evaluation, f) 
computer/el ectronics evaluation, and 
g) the Vocational Eval uation and Assess^dnt 
of Residual Empl oyabil ity profile 
(Lesnik, 1983; Mason, 1983; Sink & 
King, 1983). Finally, Chandler (1983) 
noted the objectives of vocational 
evaluation to include: 
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1. Identifying an optimal outcome 
for the individual bei ng 
served. 

2. Identifying the functional 
competencies and functional 
disabilities of the individual , 
especially in terms of the 
optimal outcome for the individ- 
ual . 

3. Identifying the services 
necessary to overcome the 
functional disabil i ties which 
prevent attainment of the 
optimal outcome. 

4. Reducing or eliminating the 
functional disabil i t i e s of 
the individual . 

Work adjustment services errohasize 
treatment more than evaluation, and 
thus focus on improving an individual's 
ability to work and to relate to 
the demands of tne work environment 
(Baker, 1983; Lassite;-, 1983). These 
services emphasize behavior change 
through pi anning, de 1 ivering , and 
monitoring those services needed 
to facilitate such behavior changes 
necessary for the patient to return 
to wor k . Baker (1983) suggested 
that a work adjustment plan should 
incl ude: 

1. A description of the specific 
behaviors to be dealt with. 

2. An identification of the 
specific work as si gnment 
or ether environment to be 
used. 

3. An identification of the 
specific treatment techniques 
to be used. 

4. An identification of the 
s peci f ic persons or agencies 
who will be carrying out 
the plan. 

5. Specific provisions for reviewing 
the plan and modifying it 
when necessary. 

Private sector vocational evaluation 
and work adjustment services typically 
sustain one another such ti.at one 
service is used in conjunction with 
the other. For example, Lassiter 
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(1983) noted that when a patient is 
being evaluated, that person is also 
undergoing adjustment. Si mi 1 arly , 
when a patient undergoes adjustment, 
evaluation is also taking place. 
Baker (1983) added that functioning 
deficits should <iot be confirmed and 
neglected, but adjustment services 
should be implemented to define the 
major functioning problems and outline 
ways to resolve them, thus facilitating 
the return to work process. 

The Carle C inic Model 

Vocational Evaluation 

The evaluation phase consists 
of two uasic steps: a) the initic.1 
interview (plan development) and b) 
implementation of the plan (Physical 
Capacity Evaluation and any other 
technique that may be suggested),, 

The initial interview consists 
of gathering and synthesizing medical 
and vocational data. Based on the 
patient's data input and the medical 
reports presented, rehabilitation 
plan goals are discussed and time 
lines given for obtaining specific 
goals. Additionally, a residual skills 
analysis with adjusted worker profiles 
is generated through the computer 
based Ability Information System. 
This system utilizes the Handbook 
for Analyzing Jobs technology to translate 
worker traits associated with jobs 
performed in the patient's work history 
to skill patterns which ca.n be matched 
to other suitable jobs (Fry, 1982). 
The final report not only lists suitable 
jobs for the patient, but adjusted 
work profiles that account for any 
physical restrictions suggested by 
the physician. 

A com pi ete vocational eval uation 
may be recommended in the initial 
report, suggesting psychometric testing , 
work samples, or work site evaluations. 
Because this service is on an individual 
basis, not all patients will need 
an evaluation battery. However, all 
patients with work-related orthopedic 
injuries a;*e required to undergo a 



Physical Capacity Evaluation (PCE) , 
scheduled as soon after the initial 
interview as possible. This is due 
in part to ihe type of pacient served 
by trie program. Often, discrepancies 
exist between what the physi ci an 
says a patient can do and what the 
patient says he or she can do (Lichten- 
stein, 1983). It is common to not 
have objecti ve medi cal evidence to 
substantiate the patient's physical 
di scomfort. The PCE is one attempt 
to add some level of objectivity 
when evaluating the patients complaints. 

The PCE eval uation procedure 
interprets the patient 1 s medical 
f i n dings and physical functioni ng 
abi 1 i ty i nto performance potential 
for vocational devel opment and pi acement 
acti vi ti es ( Ha rr and , 1982) . More 
speci fical ly , the PCE assesses the 
patient's total range of motion i n 
all upper and lower extremities, 
to include active and passive flexion 
and extension ranyes. The evaluation 
is administered by a physical therapist 
trained in this evaluation procedure, 
and performance outcomes are staffed 
by the rehabil i taticn team (physical 
therapist, occupational therapist, 
and the rehabilitation specialist). 

It is essential that the PCE 
o b j ecti ves remai n consi stent wi th 
the total evaluation program's goal 
and objectives (Harrand, 1982). 
Carle's PCE model notes the following 
objectives: 

1. To assist the staff in making 
appropriate vocational recommen- 
dations in accord with the 
patient's physical potential. 

2. To explore the patient's 
current functioning level 
and to determi ne if it is 
consi stent wi th tne medical 
findings. 

3. To make recommendations for 
additional serv * :es if a 
need is identified (i.e., 
pa in management programs , 
work hardening, physical 
therapy, or additional medical 
intervention) . 

4. To suggest the use of additional 
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evaluation techniques to assess 
questionable levels of physical 
capacity. 

Resources 

Components of the PCE that assist 
the evaluating therapist in drawing 
conclusion from patient performance 
outcomes are referred to as resources. 
One primary resource is the job analysis. 
A job analysis in this setting can 
provide information regarding the 
tas ks performed by the patient i n 
his or her previous job, the work 
environment, and the tools used to 
complete all job tasks (Pati & Adkins, 
1981). Such information can provide 
direction for the therapist when deciding 
what specific functional performance 
should be stressed, and answer specific 
referral questions posed by the rehabili- 
tation specialist (Harrand, 1982). 

Additional resources of the Carle 
Clinic PCE Model include: 

1. Initial Vocational Rehabilitation 
Assessment Report: This report 
contains a total medical history 
listing current diagnoses, 
physician imposed restrictions, 
medications, vocational work 
history with an analysis of 
the patient's current job , 
and a summary of the rehabilitation 
special ist' s recommendations. 
This information assists the 
evaluator with determining 
what the appropriate functioning 
level will be for each task 
eval uated. 
2„ Subjective Activity History: 
This involves the evaluator 
noting the patient's discomfort 
and pain symptoms as reported 
by the patient. Also, activities 
of daily living are discussed. 
This information allows the 
therapist to point out consis- 
tencies or i neons i stencies 
wi th other findings (Harrand, 
1982). 

3. Performance of Tasks: The 
evaluator synthesizes information 
obtained as a result of perfor- 
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mance following the Department 
of Labor's outline of physical 
performance demands. Specific 
actiyi ti es assessed i ncl ude 
1 if ting , carrying , sitting, 
kneeling, general mobil ity 
(crawling, reaching, climbing, 
and reclining), wal ki ng , 
balancing, running, jumping, 
repetitive stooping, reaching, 
and stacking while squatting, 
bach of these tasks are assessed 
with the use of work samples, 
as suggested by Harrand (1982). 
4. Gross Muscle Strength Tests, 
Range of Motion Tests: These 
tests rely on the Cybex Evaluation 
System. This particular 
unit has the ability to test 
all lower and upper extremities , 
providing objective EMG readings 
comparing the impaired muscle 
group with the unimpaired 
muscle group. Def ici ts i n 
one group vs. th"? other are 
demonstrated and mathematically 
confirmed. Cross confirmation 
of muscle function may be 
obtained through five tests 
measuring strength , power , 
power-endurance, isometric 
strength and fatigue. There 
is also a test that confirms 
malingering. Needless to 
say, all patients with chronic 
symptoms and having no confirmed 
medical findings are evaluated 
on the Cybex. Other patients 
may be eval uated at the discretion 
of the evaluator and rehabili- 
tation special i st (Farmer , 
1982). 

Work Hardening 



During the weekly rehabilitation 
team staffings of -individual patient's 
PCE results, a decision is made regarding 
what shoul d compri se the patient' s 
next event in the rehabil i tat ion 
program. Usual ly, the patient is 
reco mm ended physical therapy for 
specific muscle groups, to be administered 
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in conjunction with a work hardening 
program. However, not all patients 
qualify for this program because of 
i ndi vi dual patient characteristics 
that may include type of injury, previous 
work and medical history, elapsed 
time post injury, etc. 

Work hardeni ng is used to assist 
a patient with developing a sufficient 
amount of physical stamina such that 
an 8 hour work day can be achieved 
with minimal discomfort and pain (Gregory, 
Whitlow, Levine & Wasmuth, 1982). 
This process involves simulating the 
patient's work activities of a job 
he or she is expected to return to, 
or of a job in an occupational category 
in which the patient has shown a strong 
interest. This program is administered 
by occupational therapists who are 
qualified to supervise patients in 
posture correction, strength and endurance 
development. The key to success in 
work hardening is the ability of the 
therapist to tailor the program to 
the physical restrictions of the patient. 
At Carle Clinic, this involves structuring 
Ihe program to comply with the PCE 
results. Proper structuring will 
assure maximum output potential from 
the patient who in ti.rn will receive 
the maximum benefits of the program 
through total compliance with the 
various instructional activities. 

The program length usually encom- 
passes a 40 hour, four week period. 
However, this time frame may vary 
across patients, with some requiring 
more weeks for completion. During 
the contracted period, weekly rehabili- 
tation team staffings are held to 
discuss the pati ent 1 s progress , and 
to discuss alternatives should progress 
be minimal. At the conclusion of 
the program, each patient undergoes 
a second PCE to assess changes in 
baseline performance scores . Thi s 
information is submitted to the treating 
physician for rel ease-to-return- to-work 
considerations . The rehabil itation 
specialist also uses the data to develop 
final return- to-work strategies regarding 
work setting and job type. 
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Resourses 

Carle Clinic's work hardening 
model utilizes various work adjustment 
techniques cited by Gregory et al . (1- 
982). These techniques include: 

1. Job/Task Analysis: Similar 
to its role in the PCE, the 
job analysis is essential 
in developing a sound work 
hardening program that is 
accurate in simul ati ng the 
patient 1 s expected empl oyment 
setti ng. With the analysis 
in hand, the occupational 
therapi st can structure the 
work place to offer a controlled 
setting. 

2. Disciplinary Action: Because 
the work hardeni ng program 
is simul ate d work for the 
patient, the patient responsibil- 
ities to the program mirror 
those in the actual work 
pi ace An unexcused absence 
results in docked benefits 
for the periodmissed. However, 
cooperation and support must 
be sol i cited from the compensating 
source. Usually, these sources 
are more than willing to 
cooperate. 

3. CI ient Observation: The purpose 
of work hardening is two 
fold: a) to develop strength 
and b) to devel op endurance . 
This is accomplished through 
i ncreasi ng the wei ght 1 oad 
of objects i nvol ved in each 
task, or the number of repetitions 
re qui red of each task. The 
occupational therapist observes 
the patient's physical behavior 
as the patient completes 
each task , and adjusts the 
weights and number of repetitions 
so that the patients continue 
to achi eve maximum benefits 
from the physi cal acti vi ty 
exerted in each task. 

4. Productivity Rate Feedback: The 
therapi st will consi stently 
provide the patient with 
progress reports as a means 
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for supporting and encouraging 
the patient to continue with 
his or her efforts. Physical 
change is not immediate, and 
the patient should be kept 
informed of his or her daily 
progress . 

Other techniques cited by Gregory 
et al . (1982) may be employed on an 
individual basis. The four cited 
above are standard in the Carle model. 

Summary and Conclusion 

Industrial rehabilitation programs 
are breaking new ground as more medical 
facilities accept these programs into 
their respective service delivery 
systems. Such settings offer the 
advantages of in-house referral sources, 
better case coordination through the 
central ization of services , the development 
of a team approach, and the availability 
of physical and occupational therapeutic 
services. 

Physical capacity evaluations 
and work hardening programs are new 
entries in the milieu of the private 
rehabil i tat ion sector. Idea 11 y situated 
in the medical setting, these services 
offer a means to objectively evaluate 
the chronically injured patient in 
terms of physical abilities, and to 
develop a therapeutic treatment plan 
that utilizes standard work adjustment 
techniques proven to be effective 
in preparing handicapped persons for 
employment. Because the goal inindustrial 
rehabilitation is to return the patient 
to work the market for PCE and work 
hardening programs will continue to 
grow and expand. 

The business outlook for the 
tradi ti onal pri vate rehabil i tat ion 
sector may suggest a state of flux 
as more medical faci 1 ities accept 
the industrial rehabilitation model. 
More specifically, it can be expected 
that these medical programs will offer 
job placement and development services 
as well as the evaluation and therapeutic 
services now being developed, thus 
becoming aggressive competitors for 



the insurance and legal markets. 
The private practitioner is now challenged 
to address this potentially new competitor 
in a way that all parties will work 
cohesively for the benefit of the 
patient. 
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IDENTIFYING OPTIMAL WORKING CONDITIONS 
FOR PERSONS WITH LOU VISION - 
WHO IS RESPONSIBLE? 



MYRA SHALL 



ABSTRACT: This paper examines the 
strengths and weaknesses of having 
one person or a team address the issues 
of creating optimal working conditions 
for persons with low vision. It concludes 
that a team approach, with an evaluator 
serving as coordinator for the team 
will assure that vocational recommendations 
are incorporated into rehabilitation 
pi ans. 



The vocational evaluation of 
persons wi th 1 ow vision is usual ly 
not complicated by the communication 
problems associated with hearing 
impaired persons or the physical 
1 imi tation imposed by neuromuscul ar 
disorders. Yet the evaluator of 
persons with 1 ow vision faces a tremendous 
challenge which must be met with 
creativity, patience and perhaps 
most significantly, an open mind. 

As the vocational evaluator 
prepares for the assessment of these 
individuals many questions arise 
- How will the evaluee read instructions? 
If the vi sual impai rment si ows thei r 
working speed will the norms be valid? 
How much can a worksample be modified 
without undermining the original 
purpose of the worksample, or is 
any i nformation good i nformation? 
The list is endless. Fortunately 
a review of the literature and contact 
with rehabil i tation facil ities demon- 
strates progress in the area of vocational 
assessment of the visually impaired. 
Psychometri cs an * worksamples have 
been designed and/or modified for 
visually impaired persons thus providing 
the means fA r vocational assessment 
of this unK population. 

Equipped with revised tests, 
new norms, modified worksamples, 
assi sti ve devi ces and high hopes , 
the evaluator frequently begins the 
process of evaluating low vision 
individuals jnly to be stopped by 
another obstacle. Though the referring 
medical information is often lengthy, 
complex and detailed, much of the 
information reads as a foreign language 
without a reference guide for translation 
into vocational terms. Quite often 
acuity is reported according to the 
Snel 1 en Chart whi ch is 1 imi ted to 
describing acuity at a reference 
po i nt of 20 feet . Thi s i nf ormati on 
might not have any relevance to the 
sight requirements of a particular 
job. As Vanderkol k (1981 ) states 
two persons may have the ssme acuity 
but in reality function quite differ- 
ently. Also, a low vision referral 
will not necessarily include a low 
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vision exam. McCaa (1984) describes 
the sparse availability of this service 
in that only 43 states have low vision 
assessment clinics and of these states 
only 2 have 10 or more clinics. To 
further complicate the picture the 
evaluator often is in the position 
of helping an individual plan their 
vocational future without the benefit 
of a prognosis for future visual acuity. 
Given these limitations in referral 
information, the conscientious evaluator 
will often request additional referral 
information regarding fatigue factors, 
optimal visual reliance and prognosis 
(Currie, 1975). 

As 75% of legally blind individ- 
uals have been shown to have some 
potentially useful vision, the evaluator 
may choose to assume the responsibility 
for identifying and maximizing this 
vision. However, both the evaluator 
and the evaluee may experience feelings 
of frustration over the limitations 
in adapting the environment of the 
assessment area for the individual 
needs of a low vision person. Vancerkolk 
(1981) suggests the need for individ- 
ualized environments when he refers 
to low vision persons as having individual 
visual strengths. 

Richterman and Aarons (1983) 
address the subject of varying conditions 
in terms of light intensity and color 
combinations utilizing a device allowing 
the visually impaired subject to control 
the light intensity and combinations 
of color contrast. They were able 
to demonstrate improved productivity 
in 50% of the subjects with tremendous 
benefit to a few subjects. There 
was no demonstrated correlation between 
diagnosis and chosen color combination 
and light intensity. Thus the need 
is again supported for individual ized 
assessment of this type. Richterman 
and Aarons followed their study by 
making available a "Light and Color 
Work Sample" similar to the one used 
in the study. Evaluators have been 
provided with one method of assessing 
optimal light and color combinations 
of a work environment for individuals. 
Perhaps this is the beginning of a 



structured approach to assess ing 
an individual's optimal working condi- 
tions . 

Since an improved comfort level 
with regard to light intensity and 
color contrast was shown to have 
a positive effect on some visually 
impai red workers 1 producti vi ty , coul d 
there be potential for addi tional 
mani pul at ion of worki ng conditions 
yi el di ng even greater productivity 
increases? For instance , shoul d 
each 1 ow vi sion i ndi vidual be gi ven 
the opportunity for exploring work 
schedules which best accommodate 
their fatigue factor? Can low vision 
aids significantly improve productivity 
(McCaa , 1984)? How important i s 
work organization to the productivity 
and safety of a 1 ow vi sion person? 
Have the questions been researched? 
Richterman and Aarons (1981) point 
out that National Industries for 
the Bl ind was not able to find significant 
progress in the area of identifying 
needs and providing assistance for 
improvi ng the producti vi ty of 1 ow 
vision persons. 

If the factors of light intensity, 
color combinations, work organization, 
fatigue, low vision aids, etc., are 
critical to optimum work performance 
of low vision persons, at whal point 
in the re ha bi 1 i tati on process are 
these factors to be addressed and 
by whom? To what extent can low 
vision persons expect a work environment 
to be modified? Who should approach 
the potent i al em pi oyer regarding 
the environmental modifications? 

The low vision special 1st, mobil ity 
teacher, rehabilitation teacher, 
vocati onal eval uator , job pi acement 
specialist and rehabilitation engineer 
might all be logical persons to assume 
the res pons i bil ity for identifying 
optimal working conditions for low 
vision persons. Certainly the low 
vision specialist woul d have the 
technical skills for identifying 
and maximizing visual acuity with 
regard to a speci f i c job. On the 
other hand the mobility teacher could 
probably eliminate some guess work 
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pertaining to the best method of organizing 
a work station. He/she would also 
be an excellent reference for insuring 
a safe work environment. Some insight 
as to the functioning of the individual 
in activities of daily living could 
relate to the work site. This information 
could be provided by the rehabilitation 
teacher. 

The vocational evaluator also 
appears a logical choice for these 
duties since this person compiles 
a report of recommendations for job 
placement. Yet the Rehabilitation 
Engineer has even more refined skills 
with regard to modifications of working 
conditions. And finally, there is 
the job placement specialist who is 
aware of the specifics of available 
jobs and maintains communication with 
potential empl oyers . 

Obviously the majority of the 
professionals working with low vision 
persons could have a significant input 
toward identifying and developing 
optimal working conditions. Perhaps 
an effective method for dealing with 
this question is to develop a structured 
plan by which the professionals could 
work together to achieve and assist 
the low vision person in identifying 
his/her optimal working conditions. 
The strengths of each professional 
could be integrated into a package 
assessment and job site modification. 

The low vision exam is important 
but may not always be available. 
A listing of low vision clinics is 
available through the American Foundation 
for the Blind. While every effort 
should be made to obtain such an exam 
through one of these clinics there 
may be the need for vocational evaluators 
to have some basi c trai ning in and 
understanding of low vision aids. 
The evaluator might then be able to 
integrate several low vision devices 
in the evaluation process allowing 
the evaluee to have a prolonged period 
of experimentation with the aid. 
With regard to eval uation , Currie 
(1975) stated situational assessment 
is vital to understanding the visual 
functioning of the visually impaired. 



An essential component in the evaluation 
process appears to be an assessment 
en vi ronment which is control 1 abl e 
by the evaluee as well as the evaluator. 
The evaluator would seem to play 
a crucial role in the individualized 
exploration of work environments, 
condi tions and comfort level s. The 
evaluator might also coordinate the 
sharing of information among and 
between the rehabi 1 i tati on teacher 
and mobi 1 i ty teacher . In vi ew of 
the often times filled schedule of 
rehabil i tati on engineers , the actual 
job/envi ronmental modifications may 
need to be coordinated between the 
job pi c; cement special ist and the 
vocational evaluator. The job placement 
specialist might establish the rapport 
with employer while the evaluator 
provides technical assistance in 
the modification. 

In summary, to state that one 
person in a rehabilitation team could 
or should assume total conditions 
for a 1 ow vision person woul d short 
change the low vision person from 
receiving the benefit of a team approach. 
On the other hand, to ignore the 
situation and never address the subject 
of opti mal working conditions woul d 
agai n short change the 1 ow vi si on 
person. Therefore a team approach 
is suggested with the vocational 
evaluator serving as coordinator, 
since the vocational recommendations 
are formalized from their assessment. 
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VOCATIONAL EVALUATION OF BLIND AND 
VISUALLY IMPAIRED PERSONS 



Task Force on Vocational Evaluation 
of the Blind 



MICHAEL PETERSON 



ABSTRACT: The vocati on a! assessment 
of visually impaired persons is extremely 
important because, whether it is done 
formal ly or informal ly , vocational 
assessment determines all that comes 
le.ter in their rehabilitation. While 
much has happened to improve the quality 
of vocational assessment for blind 
and visually impaired persons, much 
yet needs to be done. This presentation 
overviews resources and projects related 
to the vocational evaluation of blind 
persons that are available or are 
being implemented through the American 
Foundation for the Blind (AFB), the 
Rehabi 1 i tati on Education Program, 
at Mississippi State University, and 
The Rehabilitation Research and Training 
Center in Blindness and Low Vision 
(RTC-BLV) at Mississippi State University. 



In the Spring of 1983, the American 
Foundation for the Bl ind convened 
a group of persons involved in the 
rehabilitation of the blind and in 
vocational evaluation to look at 
the state-of- tho-art i n vocational 
evaluation of blind persons and what 
is needed to improve, services. Through 
this and subsequent meetings it became 
clear that improvements in a variety 
of areas are needed . However, real 
data on the quant i ty, qual ity, and 
type of vocational evaluation services 
c or blind persons is lacking. 

Recommendat i ons were made to 
AFB to form an official task force 
on the vocational evaluation of blind 
persons that woul d undertake a major 
state-of-the-art study to determine: 
the trai ni ng needs of practi ti oners ; 
the state-of-the-art in delivery 
of services; and tiie needs perceived 
to improve services. 

AFB is presently funding this 
such a task force, and a major survey 
is being prepared that will be mailed 
to all agencies specifically serving 
blind persons as well as general 
rehabil itation facil ities throughout 
the country - a total of some 5,000 
surveys . Present timel ines , provide 
for the development of a Final Report 
in the Summer of 1985. Subsequently 
the Task Force will use its survey 
data and other e*isting data to develop 
concrete proposal s that will respond 
to the needs determined by field-based 
practitioners . 

In the process of their delibera- 
tions, however ; the task force has 
identified a number of needs and 
concerns rel ated to the vocational 
evaluation of visually blind and 
vi sual ly impaired persons . These 
are 1 isted below (Task Force on Vocational 
Evaluation of the Blind, 1983): 

1. Training of (a) vocational 
evaluations in general agencies 
to do val id vocational evaluation 
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of bl ind person and (2) vocational 
evaluators to consider job 
modi fi cations and adaptations 
in providing vocational evaluation 
of blind persons in need. 

2. Referral to vocational evaluation 
Concern was expressed that 

(a) clients are not properly 
prepared for vocational eval u- 
ation, (b) that cl ients are 
referred who have not had 
sufficient background pre- 
vocational training, vocational 
exploration, etc. to benefit 
from vocational eval uation; 
(c) and that rehabil i tat ion 
counselors do not provide 
adequate referral information 
nor ask relevant questions 
to be answered. 

3. Communication of vocational 
evaluator and refiabil itation 
counselor Concern was also 
expressed that vocational 
evaluators do not relate results 
to actual labor market conditions. 

4. Areas in which vocational 
evaluation needs to be improved , 
Ja) Assessment of 1 earni ng 

style 

(b) Assessment of vocational 
apti tudes 

(c) Specific job skills assessment 
for training on employment 
in professional , technical , 
managerial , and skilled 
professions . 

(d) Evaluation of clients 
for their, full potential 
as well as most. immediately 
available work options. 

(e) Effective individual ized, 
prescriptive reports, 
and recommendations. 

(f) Occupational information 
and expl oration during 
vocational evaluation. 

(g) Analysis of job modifications 
needed as part of vocational 
eval uation. 

(h) Vocational assessment/eval- 
uation involved in schools 
for the bl ind and publ ic 
school s . 



Training in Vocational Evaluation 
of the Blind 

Few resources have been available 
to date that give training specifically 
related to the vocational evaluation 
of blind persons. However, in the 
last two years, Mississippi State 
Uni vers i ty and Auburn Uni versi ty 
have developed graduate emphasis 
in this area. Also, the Rehabilitation 
Research and Training Center in Bl indness 
and Low Vision and Continuing Education 
programs at Auburn Uni versi ty have 
been providing in-service training. 

Mississippi States program is 
a unique a graduate program entitled 
Vocational Specialist for the Visually 
Impai red that is designed to train 
professionals to function as Rehabili- 
tation Counselors , Vocational Evaluators, 
or Placement Special ists trained 
specifically to work with blind and 
visually impa i red persons . This 
program is offered through the Rehabil i- 
tation Education Program at Mississippi 
State University (P.O. Drawer GE, 
Mississippi State, MS 39762, (601) 
325-3331) and is a unique interdis- 
ci pi inary training program that involves 
51 semester hours - 42 hours of course 
work and a 9 hours , f ul 1 semester 
interns hi p. Courses incl ude training 
in the following skills as they relate 
to bl ind persons: counsel ing, vocational 
assessment, medical i nformation , 
job placement, introduction to orientation 
and mobility training, work adjustment 
and personal - soci al adjustment. 
The program emphasizes cl ass room 
and experiential learning and connection 
with research and training activities. 
Through coo pe rati ve arrangements , 
staff of the Research and Training 
Center in Blindness and Low Vision 
teach in the program and some Counselor 
Education staff are invol ved in Research 
and Training Center projects. 

Rehabilitation Research and Training 
Center Projects in Vocational Evaluation 
of the Blind 

The Rehabilitation Research 
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and Training Center in Blindness and 
Low Vision is engaged in three projects 
related to the vocational assessment 
of visually impaired persons as consistent 
with the career development emphasis 
of the Center. These projects and 
resources are reviewed briefly below. 

Work Samples and Visually Impaired 
Persons 

A comprehensive review of vocational 
assessment and utilization of work 
samples with visually impaired persons 
was published through the R & T Center 
in 1984 (Peterson, 1984). The monograph 
was based on comprehensive literature 
review, a survey of manufacturers 
of commercial work sampl e systems , 
and a national survey of rehabilitation 
facilities for the blind. It includes 
information on the state-of-the-art 
vocational evaluation of the blind, 
employment of blind persons, approaches 
to assessment and testing of blind 
and visually impaired persons, and 
commercial and locally developed work 
samples. Two basic conclusions from 
this review, however, are: (1) there 
is a need for valid assessment samples 
that assess the occupational skills 
and potentials of visually impaired 
persons for skilled, technical, and 
professional positions; (2) improved 
assessment techniques are needed for 
the multi-handicapped blind. These 
are consistent with present issues 
identified by the AFB Task Force. 

Training Opportunities for Visually 
Impaired Persons (TOP-VIP) 

This project involves the development 
of occupational assessment material s 
in five technical or professional 
areas: (1) management; (2) counseling 
social work; (3) allied health; (4) 
computer programming; and (5) sales. 
Assessment materials are presently 
being developed that will focus on 
the characteristics needed to successfully 
train in these fields. The assessment 
model used in business and industry 
is being modified to provide a series 



of occupational exploration and assessment 
experiences that can assist a visually 
assessment experiences that can assist 
a visually impaired individual with 
personal decision-making and can 
provide a valid assessment of important 
occupational dimensions. The primary 
focus of these materials will be 
the devel opment of recommendations 
related to vocational training. 
Addi ti onal ly , TOP-VIP wi 1 1 provide 
an overvi ew of a total vocational 
assessment approach for recommending 
training in higher level occupations. 
Materials are expected to be published 
in the fall of 1986. 

Modification of the Vocational Education 
Readiness Test (VERT) 

The VERT (Thomas, 1983) involves 
a series of test originally developed 
at the Research and Curricul urn Unit 
in Vocational Education at Mississippi 
State University to assess handicapped 
students in secondary school for 
entrance into vocational education 
classes. Presently, the VERT consists 
of tests in ei ght areas : (1) auto 
mechanics; (2) basic wiring; (3) 
carpentry; (4) clothing (sewing) ; 
(5) masonry; (6) plumbing; (7) quantity 
foods; and (8) welding. Modifications 
are presently being made in selected 
tests so that they can more effectively 
be used by vocational evaluators 
who work with visually impaired persons,, 
Each test is composed of four assessment 
components: (1) performance sample 
in which actual work tasks are performed 
using tools of the trade; (2) tool 
identification; ( 3 ) vocat ional ly 
related vocabulary; and (4) vocational 
related computation and measurement. 
The adaptation of these instruments 
is presently in process. 

Electro-mechanical Work Tcisk Units 

The Rehabilitation Research 
and Training Center in Blindness 
and Low Vision (RRTC-ELV) and the 
Rehabilitation Division of the National 
Industries for the Blind (NIB) have 
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cooperatively developed several work 
samples and training tools related 
to manipulative skills and industrial 
assembly. NIB developed these work 
tasks units over the last few years 
at Royal Maid Association for the 
Blind in Hazlehurst, Mississippi. 
They are currently in use as evaluation 
and training tools. The RTC-BLV project 
involved the improvement and standardi- 
zation of existing work task * -s 
and the development of two additional 
uni ts . Specif ical ly, standardized 
manuals have been developed that are 
written in the format recommended 
by the Materials Development Center 
at the University of Wisconsin, Stout. 
Rel iabil ity and val idity studies are 
currently being conducted. Reliability 
studies are being conducted using 
a test-retest methodology with a total 
of 30 subjects. The length of time 
between tests and retest ranges from 
5 to 10 days. Val idity studies correlate 
the scores on work task units with 
sheltered industry production rates 
and scores on other work samples. 
Data is being collected at the following 
field sites: Addie McBryde Rehabilitation 
Center for the Blind, Jackson, Mississippi ; 
Royal Maid Association for the Blind, 
Hazlehurst and Tupelo, Mississippi; 
Regional Rehabilitation Center in 
Tupelo, Mississippi, and the Louisiana 
Association for the Blind, Shreveport, 
Louisiana. 

The task units provide an assessment 
of various manipulative abilities 
and work behaviors. They are intended 
primarily for use with severely handi- 
capped blind persons whose occupational 
objective is sheltered employment. 
The administration of each unit invol ves : 
(1) demonstration of the task; (2) 
practice for the cl ient unti 1 the 
task is performed correctly on these 
consecutive trials; additional practice 
of ten minutes; and (3) performance 
and/or product i on whil e the task is 
done as quickly and as precisely as 
possible usually for 50 minutes. 
A sighted standard has been developed 
for each work task unit based on the 
scores of five average, sighted workers. 



In most work task units, an electro- 
mechanical work pace rei nforcer gives 
auditory feedback when a standard 
is not meto Below, the work task 
units are listed and summarized. 

1. FINE FINGER DEXTERITY WORK TASK 
UNIT 



Assesses : Kinesthetic memory 

Bi-manual coordi nation 
Finger dexterity 
Frustration tolerance 

Task: Assembly involving: 
insertion of a plastic 
form , pi ns or corners , 
T-bar in middle, place 
in bin. 

Feedback: Buzzer sounds when 
tas k i s not compl eted 
correctly in the allotted 
time . 

Sighted Standard: 17 seconds 



2. FOOT OPERATED HINGED BOX WORK 
TASK UNIT 

Assesses: Hand-foot coordination 
Bi-manual coordi nation 
Finger dexterity 

Task: Place nut on a bolt, 
place in hinged box, 
automatic counter. 

Feedback: Buzzer sounds when 
task is not compl eted 
correctly in the allotted 
time. 

Sighted Standard: 5 seconds 



3. HINGED BOX WORK TASK UNIT 

Assesses: Tactual perception 
Material control 
Bi-manual coordination 
Frustration tolerance 
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Task: 



Feedback: 



Place card in plastic 
bag, open box and place 
inside, auto counter. 

Buzzer sounds when 
task is not com pi eted 
correctly in the allotted 
time. 



Sighted Standard : 8 seconds 



correctly in the allotted 
time. 



Sighted Standard: 



4 seconds 



INDEX CARD WORK TASK Up! IT 



The manual s of the work task 
units are presently available, for 
$15.00, through the Rehabilitation 
Research and Training Center in Bl indness 
and Low Vision, Post Office Box 5365, 
Mississippi State, Mississippi 39762. 



Assesses: Bi-manual coordination 
Finger dexterity 
Frustration tolerance 
Memo ry for sequence 
of operations 

Task: Pick up 2 cards, push 
to divider and then 
Ujj until hear a "cl ick 11 . 
Right card to right, 
left to right position 
up another. 

Feedback: Buzzer sounds when 
task is not not completed 
correctly in the allotted 
time. 



Sighted Standard: 



4 seconds 



MULTIFUNCTIONAL WORK TASK UNIT 



Assesses: 



Task: 



Bi -manual coord i nation 
Finger Dexterity 
Kinesthetic memory 
Abil ity to work with 
others 

Fill 168 holes with 
vial s and assembl ed 
materials (nuts and 
bolts). This is done 
cooperatively i t h 
other clients. An 



observation 
work behavior. 



sheet of 
is used. 



Resources in Vocational Evaluation 
of the Blind 

Training 

1. Vocati onal Special i st for the 

Visually Impaired 

Rehabilitation Education Program 
Mississippi State University 
P.O. Drawer GE 

Mississippi State, MS 39762 
(601) 325-3331 

Contact: Michael Peterson, Director 

2. Vocation a l Evaluation for the 

Bl incTand Deaf 

Department of Special Education 

and Rehabilitation 
Auburn University 
Auburn, AL 

Contact: Randy McDaniel 

Graduate Coordinator 

3 . R e h a b i 1 i tat ion Research and 



Training 
and Low Vision 



Cent er in Bl indness 
(RRTC-BLV) 



Mississippi State University 
P.O. Drawer GE 

Mississippi State, MS 39762 
Contact: Martha Bagley 

Training Director 

Research and Development 



Feedback: 



Buzzer 
ta s k is 



sounds when 
not completed 



Task Force on Vocational Eval uation 
of the Blind 
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American Foundation for the Blind 
15 W. 16th Street 
New York, NY 10011 
(212) 620-2000 
Contact: Frank Simpson 

Employment Specia 1 ist 

2 . Rehabil iiativn Re r qarch and Traini ng 
Center in Blindness and Low Vision 

Mississippi State University 

P.O. Drawer GE 

Mississippi State, MS 3^762 

(601) 325-2001 

Contact: Steve Machalovf 

Research Director 
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THE VOCATIONAL EVALUATION OF HEAD 
INJURED PATIENTS 



JUDI WEINBERGER 



ABSTRACT: Each year 400,000 to 600,000 
persons sustain a severe traumatic 
head injury. As a result of technological 
advances in medicine and rehabilitation, 
increasing numbers of head injured 
persons are surviving, yet 30,000 
to 50,000 a year continue to manifest 
disabilities severe enough to preclude 
a return to a normal life (U.S. Department 
of Education, 1981). A significant 
portion of this group consists of 
adolescents and young adults involved 
in automobile, motorcycle or sports 
accidents (Kalsbeck, McLaurin, Harris, 
& Miller, 1980). One of the most 
difficult challenges these individuals 
face is entering into the workforce. 

In recent years, there has been 
an influx of individuals with traumatic 
head injuries seeking vocational services. 
These individuals pose a particular 
challenge for the vocational evaluator 
accustomed to working with the physically 
disabled because of the combination 
of physical, cognitive, and behavioral 
impairments associated with head injuries. 
The complexity of this disability 
has led vocational evaluators to question 
the efficacy of standard vocational 
asses sment procedures. This pa per 
addresses the rol e of vocational evaluation 
in the rehabilitation of the head 
injured patient, focusing on the limi- 
tations of traditional assessment 
procedures, and the need for alternative 
means of evaluating this population. 



Functional Limitations 

An i ndi vi dual who has suffered 
a traumatic head injury is typically 
left with a complex set of deficiencies. 
Unlike other diseases of the brain 
(i.e., Stroke , brain tumor) that 
result in localized brain damage 
and predictable functional consequences 
(Lezak, 1983), a head injury results 
in damage to diffuse areas of the 
brain. As a result, each patient 
presents a unique set of symptoms 
and functional deficits which contributes 
to the di f ricul ty i n worki ng with 
this population (Anderson, 1981). 

The mul ti pi i city of deficits 
for the head i n jured are noted i n 
physical , cognitive, and behavioral 
functioning. In addition to hemi paresis, 
physical impairments may include 
muscle spasticity, seizures, receptive 
and/or expressi ve aphasia , vi sual 
and sensory def ici ts , and reduced 
bowel and bladder control (Anderson, 
1981). 

Memory impairments are the most 
f requentl y ci ted cognitive deficits 
by head i n jured patients (Benton , 
1979 ) . Other cognitive deficits 
that interfere with vocational functioning 
may incl ude decreas 1 attention span 
and concentration; increased distractibi- 
1 i ty ; impa i red 1 earning abil ity, 
slowing in the speed of information 
processing, reaction time and decision 
making; diminished abstract reasoning; 
and decreased generalization of ideas 
and tasks (Benton, 1979; Long & Webb, 
1983). 

Cognitive limitations and distur- 
bances in social behavior have a 
strong negative impact upon returning 
to gainful em pi oyment (Na jenson , 
Grosswasser, Mendelson, & Hackett, 
1980). Following a head injury, 
changes in personality and temperament 
which impact on social behavior are 
often noted. The head injured patient 
may experience fluctuations in affect 
and mood (including depression and 
euphoria), lowered tolerance for 
frustration, and easily succumbs 
to fati gue . In addition, increased 
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egocentrici ty results in a diminished 
awareness of social conventions, sensi- 
tivity to others' feelings and feedback 
concerning their own actions. Further, 
many head injured patients will experience 
difficulty in spontaneously initiating 
purposeful activities and planning 
for the future (Benton, 1979; Lynch, 
1983). 

A major obstacle for the vocational 
evaluator is the head injured patient's 
lack of awareness of his/her current 
deficits (Rosenthal, 1983). Commonly, 
they perceive themselves functioning 
as they had prior to the injury. 
This lack of awareness is much a function 
of cognitive deficits as psychological 
defenses such as denial . In general , 
the personality and behavioral changes 
experiences by the head injured patient 
are a result of pathology to specific 
areas in the brain, complicated by 
the psychological aspects of dealing 
with the disability. 

Vocational Evaluation 

It is helpful to conceptualize 
two distinct^ but related, phases 
of vocational evaluation during the 
rehabilitation process for the head 
injured patient. The first phase 
ideally begins whil e the patient continues 
to receive physical, occupational 
and speech therapies. The patient 
should be generally oriented to the 
environment and capable of performing 
purposeful activities for short interval s 
of time. During this time, the purpose 
of vocational evaluation is to obtain 
and provide information to the interdis- 
ci pi ina ry rehabil i tat ion team about 
the types of skills which would be 
necessary for the patient to return 
to his previous level of functioning 
in work or school , and to allow the 
patient an opportunity to practice 
these or related activities. This 
phase of vocational evaluation is 
most a ppropriate for patients who 
have had a previous work history. 

For example, a 32 year old mailman 
sustained a head injury resulting 
most notable in left hemiparesis, 
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short term memory def i ci ts , i nappropriate 
affect, and depression. Of significant 
importance to his rehabilitation 
wa s his d i f f i c u 1 ty in recognizing 
how the exercises performed in physical , 
occupational and speech therapies 
would assist him in returning to 
work as a mailman. He often became 
disruptive and refused to participate 
in therapi es . When the vocational 
eval uation began , thi s patient was 
re pea ted 1 y gi ven tas ks rel a ted to 
mail sorting, beginning with sorting 
titles by color and progressing to 
sorting letters and packages. He 
was motivated to perform these tasks 
as they were di recti y rel a ted to 
his job. The other therapies began 
to incorporate job-related tasks 
into their routines which the patient 
readily performed. The patient eventually 
returned to work as a mailman. 

The second phase of vocational 
evaluation should begin once the 
cl ient has received maximum benefit 
from the physical rehabilitation 
and cogni ti ve remedi ati on programs 
(see Gianutsos, 1980; Pollack, Kohn, 
Mi 1 1 er , 1984 for a descri pti on of 
cognitive remediation). The purpose 
of thi s phase i s to assess residual 
vocational assets and 1 imitations , 
and provide recommendations for compet- 
itive employment or an alternative 
placement. Before beginning the 
eval uation process , the vocational 
evaluator must consult with the inter- 
disci pi inary team in order to understand 
the combination and degree of physical 
and cognitive deficits. Once this 
information is obtained, the evaluator 
can design and evaluation program 
which is tailored specifically to 
the individual r.eeJs of each head 
injured patient. 

As with other populations, present 
skills, capacities for new learning 
and work behaviors are of major consi- 
deration during the vocational evalu- 
ation. The process i s compl i cated , 
however, by the head injured patient's 
myri -id of cogni ti ve def ici ts that 
result in difficulties in transferring 
a da pti ce strategi es and behaviors 
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from one context to another. The 
presumed integration of skills and 
aptitudes and generalization of other 
contexts as assessed through aptitude 
testing and work sampling frequently 
does not occur for the head injured 
patient (Silver, Lakin, Ross, Rattok, 
Thomas, Diller, & Ben-Yishay, 1982). 
Thus, traditional testing measures 
generally are weak predictors of work 
potential . 

For example, a head injured patient 
may successfully be able to file 3" 
x 5" cards in alphabetical order. 
However, it can not be presumed that 
this patient would be capable of working 
as a file clerk. The significance 
of limitations such as hemiparesis, 
distractibil ity, or poor organizational 
skills exhi bi ted in an actual work 
situation, may not have been apparent 
during the work sampling. Conversely, 
a patient with aphasia may not be 
able to complete an adding machine 
work sample invol ving written instructions, 
but may be able to work as an office 
clerk using an adding machine where 
instructions are given verbally. 
Finally, a patient may have average 
verbal and numerical aptitudes as 
demonstrated by paper and pencil aptitude 
testing. However, short term memory 
deficits may preclude his ability 
to enter into occupations which would 
incorporate these aptitudes. The 
aptitude tasting alone would not be 
able to demonstrate the effects of 
such memory deficits. 

In addition to aptitudes and 
skills, work behaviors displayed during 
the structured testing situation may 
not be evidenced consistently in the 
actual work setting. The patient 
may display appropriate work behaviors 
in a quiet, nondi stract i ng setting 
when tasks are presented one at a 
time the patient's work behavior may 
deteriorate, though, when placed in 
a noi sy work envi ronment wi th many 
co-workers in close proximity and 
several work duties which are presented 
at the same time. 



Assessment Techniques 

Due to the limited value of 
standard assessment procedures, a 
creati ve , indi vidua 1 i zed approach 
is needed for a formal assessment 
of specific work skills and learning 
potential . The eval uator must determine 
not only whether the head injured 
patient can perform certain tasks 
within acceptable time limits, but 
al so the manner in which new information 
is learned, whether the patient can 
resist distractions and stay on task, 
and whether the performance can be 
repeated. In addition, the evaluator 
should be cognizant of compensatory 
strategi es (i.e., memory aids) that 
the patient might employ in order 
to successful ly complete tasks. 
If the patient does not use compensatory 
techniques , the eval uator can assist 
the patient to develop strategi es 
which might enhance his/her work 
performance . 

Standardized work samples are 
effective in evaluating skills and 
1 earni ng potenti al when used in a 
f 1 exi bl e , nonconventional manner. 
Care must be taken, however, when 
interpreting the results of the patient's 
performance since the normative data 
associated with each work sample 
is rendered invalid with the deviations 
from the administration protocol . 
Therefore, close observation of the 
patient's performance is crucial 
in order to assess his/her learning 
potential . 

A detailed case example will 
demonstrate the use of modified work 
samples in assessing the vocational 
capabilities of head injured patients: 

A 19 year old head injured patient 
was given the Computing Postage Work 
Sample of the JEVS Work Samples. 
The pati ent was unabl e to compl ete 
the work sample because he had difficulty 
comprehending and performing the 
mul ti -step wri tten di recti ons . Thi s 
appeared to be the result of cognitive 
impai rments i ncl udi ng poor organizational 
skills, short term memory deficits, 
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distractibil ity, and 1 imited frustration 
tolerance. 

The evaluator assisted the patient 
by reading the instructions to him 
and helping him to devise a simple 
flow chart to help him remember the 
order of the steps required to complete 
the task. Next to decrease the 1 ikel ihood 
of the patient becoming frustrated, 
the evaluator demonstrated each step 
of the tasks and had the patient repeat 
each step on his own. In approxi- 
mately three hours, the patient was 
abl e to f ol 1 ow the f 1 ow chart i ndependently 
and successful ly compl ete the task. 
Although time consuming, the flow 
chart was invaluable in assisting 
the patient to compensate for his 
distractibil ity, poor organizational 
skills, and short term memory deficits. 
The patient was able to repeat his 
performance the next day with minimal 
assistance.. By the third day, with 
the use of the flow chart, he was 
completing the tasks independently. 

The evaluator was able to assess 
the types of specific work skills 
that the patient was capabl e of performing 
and devise an effective method for 
the patient to learn tasks while com- 
pensating for cognitive deficits. 
This information was invaluable when 
placing the patient in competitive 
empl oyment. 

As stated previously, work behaviors 
displayed during a structured vocational 
evaluation may not be evidenced consis- 
tently in a less structured work setting. 
Therefore, the evaluator should not 
rely solely on information obtained 
during a traditional vocational evaluation 
in order to predict work behaviors 
on the job. Rehabilitation facilities 
are be gi nni ng to i ncorporatc work 
tryouts into the vocational evaluation 
of the head injured patient (Musante, 
1983; Silver et al . , 1982). An extended 
evaluation in an actual work setting 
allows the evaluator to conduct repeated 
evaluations of behaviors end skills 
in order to assess changes in work 
behaviors and the patient's potential 
for learning. During this time, the 
evaluator can help the head injured 
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patient devi se compensatory methods 
for completing tasks and modifying 
behaviors whi ch woul d i nterfere wi th 
successful job placement. 

At Kessler Institute for Rehabili- 
tation in New Jersey v head injured 
patients have the opportunity to 
vol unteer for approximately twenty 
weeks in a department within the 
hospital which reflects their interests 
and work potential. Such departments 
may include dietary, housekeeping 9 
maintenance , medical records, purchasing, 
or clerical services. The patient 
works under the supervision of an 
employee in the department. Before 
beginning the work tryout, the patient 
and the supervisor sign a "Work Agreement" 
detailing a rationale for the work 
e x peri e nee , work behaviors expected 
on the job , and an outl ine of job 
res pons ibil ities. 

During the work experience, 
the supervisor compl etes repeated 
eval uation reports cf the patients 1 s 
work behaviors and job performance. 
The evaluator^ in ^: \ ration with 
the supervisor, u->.«*T.s ~> *. parent 
to desi gn techni ques tc compensate 
for cognitive or physical limitations 
in order to imp^-ve job performance „ 
Also, the patient receive 8 .-, counseling 
to incorporate mcrs appropriate work 
behaviors intc the war- setting. 
By compari ng t v a ! >iai.vjn reports , 
the patient is : .o objectively 

review his/her \ > x-^/ess during the 
work tryout and note areas that require 
additional improvements . 

After the completion of the 
vocational evaluation and work tryout:;, 
recommendations are made for ■ r.^ 
pa t i e nt to be gi n worki ng in ei i >e 
a competitive job or an alternate v.~ 
placement (i.e., sheltered employment, 
volunteer position). Eval uatio . 
services shoul d not end at the time 
of pi a cement , but shoul d conti nue 
wi th the assistance of the new job 
supervisor to eval uate patients adaption 
to the work setting and job duties. 
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Conclusion 

Each head injured patient presents 
a unique array of physical, cognitive, 
and behavioral limitations which impacts 
strongly upon his/her vocational func- 
tioning. Traditional methods of evaluating 
work potential (i.e., aptitude testing 
and work sampling) have proven to 
be of limited value when assessing 
this population. Instead, a creative 
and individualized approach is needed 
for the assessment of a head injured 
patient's work skills, behaviors, 
and learning potential. This includes 
flexibility in the use of work samples 
and extended work tryouts. 

The role of the vocational evaluator 
with the head inj.jred population extends 
beyond assessment. The evaluator 
also must help the patient devise 
compensatory strategies to complete 
job tasks and develop appropriate 
work behaviors. In order to preform 
the dual roles of assessment and reme- 
diation, special personal qualities 
are demanded of the evaluator; notably 
good probl em solving skills, flexibility, 
and emotional sensitivity* Equally 
important, the evaluator must possess 
a thorough understanding of the multi- 
plicity of deficits presented by head 
injured patients and their impact 
upon work functioning. Specialized 
training consisting of formal coursework, 
in-service seminars, and supervised 
work ex peri ences wi th head i n jured 
patients is strongly recommended for 
all vocational evaluators working 
this population. 
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PREVOCATIONAL EVALUATION: 
A MIND SET OR A PROCESS 



DARRELL COFFEY 
EDNA SZYMANSKI 
PAMELA JONES STRONG 



ABSTRACT: Students born with disabil ities 
and students with developmental problems 
often experience difficulty in obtaining 
work and adjusting to post-school 
employment. Lacking proper help, 
treatment, or training, many will 
remain unemployed or be underemployed. 
In addition, habilitation for many 
in these groups is primarily a learning 
process. For these reasons it is 
important that job-related problems 
be recognized early and that, at the 
proper time, they be appropriately 
dealt with. This paper deals with 
the limitations of a single focus 
approach to evaluation and a developmental 
approach to prevocational evaluation 
in school setting. 



Assessment 

Historically, prevocational 
evaluation has focused on older youth 
with special vocationally related 
needs. Results have been positive 
as students have been helped to make 
more effective post-school decisions, 
plans and adjustments. Sponsors 
of vocational eval uation have been 
cri ti ci zed , however , for this late 
"one-shot" approach. The approach 
tends to ignore maturation and potential 
developmental efforts and it allows 
a "mind set" to develop for each 
student; even when hel pful it s ti 1 1 
provides too little too late. A 
better approach for special needs 
students would usually be prevocational 
evaluation of a developmental nature. 
In a developmental approach, integrated 
with career education, even younger 
students would, or could, be evaluated 
with salected aspects of the world 
of work kept in mi nd. An advantage 
of early evaluation would be that 
many years of school effort could, 
if necessary, focus on work related 
remedial efforts. As a result, the 
prevocational evaluation and career 
education efforts coul d become a 
team effort in a developmental process 
rather than a stable prevocational 
or vocational plan of action. 



Some school s have res ponded 
to special student problems by introducing 
vocational rehabil i tat ion special i sts 
into their programming. These specialists 
are, by training and experience, 
more familiar with overcomi ng or 
circumventing disabilities and with 
helping di sabl ed peopl e to enter 
into and adjust to the labor market. 
A solution to student problems in 
these schools is a devel opmental 
prevocational eval uation , that over 
time, brings together, in team, special 
students, parents, teachers, and 
rehabilitation specialists. The 
team members study the student holis- 
tically; collect, analyze and synthesize 
work-related data and make school/work 
related recommendations. 
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A proper context for prevocational 
observations and evaluations is the 
school setting, which now has a vocational 
flavor analogous to that found in 
career education. In this context, 
students are provided a learning environ- 
ment and a set of goals which attempt 
to relate their total education to 
the world of work. As learning situations 
become more work-oriented, both the 
students and the teachers begin to 
recognize work-related problems. 
In addition, the rehabil itation specialist 
and/or the special ly trained teacher 
will begin to identify work-related 
learning activities that will help 
solve the work-related problems and 
overcome barriers to post-school adjustment 
and success. 

Process 

Prevocational evaluation measures 
the existence of and potential for 
the development of work skills and 
related work behavior by students 
with special needs. (Adapted from 
VEWAA glossary 1983). The process 
of assessment (and related treatment) 
varies as students mature. Older 
students in prevocational evaluation 
are monitored and may be offered special 
training. If vocational problems 
persist in older students they may 
be referred to a vocational evaluator 
for a comprehensive vocational evaluation. 
Work rel ated assessment and work adjustment 
with younger students will differ 
from that with older students: primarily, 
assessment will be more general in 
its focus. The results of assessment 
with this group will be less reliable 
and prevocational evaluation at younger 
ages will be more concerned with the 
development of a "work personal ity. 11 

Tools 

Most vocational assessment tool s 
are more effective with older students 
where they measure , or attempt to 
measure, factors which have been closely 
def i ned ; these cri ti cal factors can 
be observed or identified at the point 



of contact between the assessor a. 
the assessee. The evaluator is then 
usually able to reflect this information 
against norms or other information 
of a historical nature. As a result, 
select predictions can then be made 
about the vocational future of the 
person being assessed. Some of these 
predictions have been fairly valid 
and reliable, however, the degree 
of accuracy decreases with the breadth of 
the measurement. If these prevocational 
evaluation tools are relied on too 
much with young students , the predictions 
will be poor and the school planning 
will tend to be very narrow and inflex- 
ible. If prevocational eval uation 
does fiO t go beyond the use of one 
or two special instruments any related 
school pr o grammi ng may resul t in 
a mind- set that is not helpful for 
a students. A better choice is a 
dynamic eval uation process and treatment 
program that develops over the school 
years . 

Dynamic Prevocational Evaluation 

The major premise of this paper 
is: voca ti onal 1 y rel ated probl em 
recogni ti on and treatment is, and 
ought to be, a continuing process 
throughout a student's school years. 
A vocational diagnostic and treatment 
team has the potential to recognize 
many early subtle indicators of future 
school and work problems. The team, 
under a work-orie ited leader, can 
screen, plan appropriate in-depth 
and extended assessment , schedul e 
fol 1 ow-al ong assessment and effect 
meaningful and appropriate work-related 
1 earni ng activities . This team can 
provide or refer to high priority 
speci al programming for the special 
students. The team will operate 
most ef f ecti vely when becoming eco- 
nomically productive is a major long 
range objective for special education, 
vocational education , prevocational 
programming and the students. 

Comparisons are an important 
aspect of the dynamic prevocational 
process. StudeLts with disabilities 
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or critical job-related limitations 
are able to compare themselves w:th 
others who have succeeded on specific 
jobs. School planning and counseling 
can then ask about "what to do next". 
Students are also able to monitor 
their own job or work related growth 
and development over time. 

Functional assessement, a concept 
important in vocational rehabilitation, 
is helpful in considering dynamic 
prevocational evaluation. First we 
will look at a definition: Functional 
assessment is "the measurement of 
purposeful be ha vi or in i nteract ion 
with the environment which is interpreted 
according to the assessment's intended 
uses ." (Hal pern and Fuhrer , 1984) 
Vocational ly oriented rehabilitation 
specialists in school settings must 
be concerned with and knowledgable 
about or skilled in all key elements 
of this definition as they relate 
to students with disabilities and 
to work. Teachers, too, consider 
the same elements of functional assessment 
but they do this in relation to more 
general life and social goals and 
to teach i ng and 1 earning activities. 
As a result the tasks of the special 
vocational team becomes one of bringing 
together the specialists and the teachers 
who can then provide long range work- 
related diagnosis and treatment wi fch 
special students. The process begins 
with student problem recognition and 
cl assi fication. 

In summary, recognition of student 
problems is much easier when the eval uator 
knows what to look for, the proper 
context in which to do the looking 
and how to make valid comparisons 
of student characteristics with significant 
work factors. It is important also 
that the school eval uator and di rect- 
contact school staff know how to relate 
1 earni ng and 1 earni ng activities to 
important work factors. 

Program Introduce ioi 

Prevocational evaluation is almost 
always employed too late in a stuicnt's 
educational career to enable full 



uti 1 i zation of educational resources 
in vocational preparation. Currently, 
prevocational evaluational and/or 
prevocational trai ni ng begi ns when 
the student enters the high school, 
The student's age is usually 14 or 
15 and, at best, this gives the students 
six years to obtain the skills necessary 
fo.* employabil ity since many students 
choose to 1 eave hi gh school before 
their 21st birthday and, thereby, 
cut down on the time to train for 
employabil ity. 

Prevoca t i onal eval uat ion has 
high potential for use in the assessment 
of and preparation of disabled students 
for work. The assumption is that 
prevocational eval uat ion will hel p 
students to become more effective 
in self-assessment, in life and career 
planning and development and in specific 
vocati onal and vocationally related 
planning, decision-making, education, 
special preparation and employment. 
These potential s have , however, generally 
not been realized even through pre- 
vocational eval uat ion is available 
in numerous school settings. It 
has not been fully embraced with 
some of the reasons for this slow 
acceptance appearing to be systemic 
and as follows. 

The results of prevocational 
or vocational evaluations are frequently 
not ful ly or effectively util ized 
in planning a student's educational 
program. In some cases, the reports 
may not even be avail abl e to those 
charged with development and imple- 
mentation of the student's educational 
plan. 

The concept of pre vocati onal 
evaluation as a process is often 
misunderstood by both educational 
and rehabilitation personnel. For 
instance some feel that a prevocational 
eval uat ion provides definite answers 
to all possi ble vocational planning 
questions. Others use the results 
as the only information in vocational 
planning rather than as just one 
part of a multi-faceted and life-long 
vocational planning and developmental 
process. 
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Collection of information about 
the student and the relating of this 
information to work comprises a significant 
portion of the prevocational evaluation. 
During the school years, teachers, 
other school personnel , and parents 
prov ide often over! ooked or underutil ized 
vocational information about students. 
When this valuable information is 
analyzed and appl ied i n conjunction 
with consultation by qualified rehabili- 
tation counselors or vocational evaluators, 
the result can be a more fruitful 
use of the educational years in the 
vocational preparation of students 
with disabilities. 

The Utica Approach 

A major objecti ve of vocational 
rehabilitation, of special education 
and of vocational education special 
programming in the Utica, New York 
school system is to help individuals 
with handicaps to later become as 
economically productive as possible. 
Prevocational evaluation as it occurs 
in the Utica school system supports 
this objective with younger students 
to: 

1) Facilitate educational and 
vocational planning 

2) identify vocationally related 
strengths 

3) relate these strengths to 
job clusters and categories 

4) identify deficits and weaknesses 
in job related skills, knowl edges 
and behaviors 

5) analyze limitations and deficits 
in terms of vocational goals 
and prescri be training goals 
and work re 1 a ted acti vi ti es 
which wil 1 hel p to make the 
student work ready 

6) monitor student goals and 
functioning as they progress 
toward vocational goals. 

01 der students, especial ly those 
with complex and unsolved vocational 
problems are referred for more compre- 
hensive vocati onal eval uation . In 
the lower grades of the school during 
prevocational evaluation and preparation 



more emphasis is placed on the following 
learning rel ated activities: general 
work orientation and awareness, relating 
school tasks and situations to work 
tasks and situations, and relating 
cart- r.* ex pi oration to assessment 
expes fences . 

Iht model described and illustrated 
in this paper attempts to refocus 
the way in which prevocational evaluation 
is perceived and used in the school 
setti ng. Early screening, real istic 
expectations and mul ti -disci pi inary 
team efforts are critical to this 
model . In this model : 

1) Prevocational evaluation 
of adolescents and children can provide 
only a gl impse of i ni ti al patterns 
of vocational strengths and weaknesses. 
This evaluation should not be viewed 
as other than a rough, early view 
which can suggest immediate remedial 
measures, and future work-related 
general questions and general school 
pi anning. 

2) Prevocational eval uations 
during the el ement a ry years hel p 
students and parents to develop more 
realistic expectations. When students 
and parents are helped to understand, 
at an early age, the requirements 
for broad occupational areas, more 
student sel f-assessment and self-direction 
will be possible. 

3) A multi-disciplinary team 
effort will help to make the prevocational 
evaluation most effective. The team 
may include specialists from the 
discipl ines of rehabil i tation counseling 
and/or vocational eval uation , school 
psychol ogy , school counsel ing, social 
work and work adjustment. It must 
also involve the parents and student, 
where appropriate, as team numbers. 
The major team members may vary from 
setting to setting. The following 
members are , however , essential with 
chil dren experienci ng devel opmrntal 
problems: the special education 
cl ass room teacher; an administrator; 
the parent; and the rehabilitation 
counselor and/or vocational evaluator. 
These team members can ensure that 
the results of the initial prevocational 
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evaluation are incorporated into the 
student's home life and educational 
plan and provide a stronger framework 
for future vocational endeavors. 

Parents as part of the planning 
team gain realistic expectations of 
job potential. This can lead to their 
expecting a son/daughter to develop 
a sense of responsibility through 
performing needed household chores. 
Although this principle holds for 
all children, it is almost an imperative 
for the child with a developmental 
disability* Without these expectations 
and responsibilities, there is little 
probability of later success in the 
work place. 

In this model of prevocational 
evaluation, students and parents are 
included as active participants in 
the initial stages. Students are 
observed by team members and parents 
in regular classrooms, in extra-curricular 
activities, in prevocational activities 
and in other specially structured 
activities within the school setting. 
The observation period may vary in 
length depending on how the activities 
are structured. For maximum efficiency 
and minimum interference with other 
school programs, the intensive part 
of this model should probably not 
total more than 3 days over a 2-month 
period. The following questions for™ 
the focal points of the observation 
and later team meeting: 

1) Will the normal course of 
academic preparation, available 
in the school, prepare this 
student for employment (competitive 
or otherwise)? 

2) Given this student's physical 
and intellectual potential, 
what o ecu pa ti onal areas are 
most possi ble and what occupational 
areas are least possible? 

3) What, if any, changes in a 
student's educational program 
are necessary to increase 
the probability of success 
in competitive employment? 

4) What behavioral changes other 
than normal maturation will 
be necessary to enable this 



student tc obtai n , maintain 
and find satisfaction in 
a job? 

5) What kinds of related activities 
can parents and students 
engage in at home to increase 
employabil ity? 

6) What are the labor market 
trends in the community? 

7) What are the family's plans 
for future resi dence? For 
example, many parents of 
Down's Syndrome children 
are retiring at the same 
time their children are completing 
school . 

The intensive part of the prevo- 
cational process should optimally 
occur during the elementary years, 
probably around ages 9 and 11. In 
this way, the student's school pattern 
will already be sufficiently establ ished 
to provide good information yet there 
will be sufficient time for remedial 
or refocusing efforts to positively 
affect the student' s educational 
future. 

The process would probably require 
a 1 to 2 week commitment and effort 
each year from school staff and rehabil i- 
tation staff. This early intervention 
would screen the student once during 
the pre-teen years. 

The student' s next in vol vement 
may well be with a more formal and 
com pre hens i ve vo cat i onal eval uation 
during the adol escent years . At 
this stage, the student would optimally 
also be involved in summer work experience 
programs. There is a good probability 
that the results of the later evaluation 
woul d be posi ti vely inf 1 uenced by 
the early intervention efforts. 

The team effort whi ch i ncl uded 
parents, students, and classroom 
teachers woul d a 1 ready have he! ped 
in: (1) the delegating of responsibilities 
to each team member and (2) ensuring 
ownership of the educational plan 
and its implementation by all interested 
parti es . The team effort combined 
with prevocational eval uation in 
a school setti ng is pro-acti ve; it 
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An additional and important note at 
this point is that the time allocation 
be state vocational rehabilitation 
staff could easily be justified by 
the probability of a more vocationally 
feasible referral in the future as 
a result of this early intervention. 

Utica Case Summaries 

Following are three hypothetical 
case summaries to illustrate and help 
define the model . 

A. Joshua is a 10-year-old student 
who attends public school classes 
for the moderately mental ly handicapped. 
He is not independent in many activity 
of daily living skills. Joshua seems 
somewhat clumsy around the classroom 
and doesn't willingly participate 
in recreational activities with his 
cl assmates. 

A prevocational eval uation suggested 
that Joshua should receive further 
evaluation due to obvious perceptual 
motor difficulties. Adaptive physical 
education, occupational therapy and 
physical therapy have since been instituted 
to improve coordination and balance. 
A significant decrease in classroom 
"clumsiness" has resulted. The student 
sometimes participates willingly in 
recreational acti vi ties . 

During the team meeting which 
included the parents, the student's 
apparent dependency in daily living 
skills was brought, out by the teacher; 
the student neither dresses himself 
nor attends to his own hygiene needs. 
After discussion, the parents admitted 
that they felt they might be doing 
too much for Joshua . A pi an was devel oped 
in which the parents agreed to help 
Joshua learn to do more for himself. 
Joshua was also to be held responsible 
for chores around the house. 

Joshua's teacher reports that 
his general level of self-confidence 
and his relationships with his peers 
seem to have improved in the year 
following the evaluation team meeting. 



average intellectual ability. Her 
disability is cerebral palsy, affecting 
all four 1 imbs and causing a significant 
speech impediment. Her writing is 
barely legible and writing takes 
her much longer than is required 
by her peers. Jean doesn't like 
school very much and she seems unable 
to keep up with her peers in class. 

After a prevocational evaluation 
and an occupational therapy consultation, 
Jean began using a computer with 
a word processor for much of her 
written work in school. At the same 
time, Jean was taught how to use 
the computer to hel p her with mathematics 
lessons. Special software helped 
her to do math drills with minimal 
input and increased learning. 

Jean's family was so impressed 
with Jean's interest that they bought 
her an inexpensive home computer. 
Two things have occurred which have 
changed the way Jean views school : 
1) her written work doesn't take 
as 1 ong and i s neater in appearance ; 
and 2 ) Jean has 1 earned more about 
computers and is able to impress 
her classmates with a positive skill. 

From a vocational standpoint, 
Jean wil 1 be better prepared due 
to her continually improving skill 
in using computers for written communi- 
cation and learning. Her writing 
would never really have been functional 
in a work setting. 

C. When James was 9, his parents 
met with his special education teacher, 
rehabilitation counselor and other 
school staff. The discussion revolved 
around what James woul d be doing 
10 years from now. The parents seemed 
to think he would be doing the same 
things he does now but that we would 
be ol der. The teachers stated that 
James seemed to be strong but poorly 
coordinated and said he would benefit 
from adaptive phys ical education 
where he woul d work on knowing where 
his body was in space and large muscle 
activities. Al so , fol lowing direction, 
skills should be addressed. James' 
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communication is good, he lik*s tr. 
be outside, and he has a good attention 
span, but he does not take care jf 
his clothing or anyone's property. 

Discussion involved what James 
might choose to do after school. 
Ideas of potential jobs presented 
to the parents were groundskeeping 
attendant, carpenter's helper and 
similar work. It was suggested that 
he became involved in a community 
swim program and active in physical 
education in school, be given daily 
family chores and be expected to hand 
or fold his clothes after school. 
He also should be given a small allowance. 
School and home will help James become 
more aware of peopl e doi ng jobs in 
his community and help him to better 
evaluate himself in relation to these 
and similar jobs. 

Summary of Cases 

These cases highlight the potential 
benefits of an early prevocational 
evaluation using a team approach. 
This team approach could result in 
positive program changes to help students 
more fully develop educational and 
vocational potential. The team approach 
to education, vocational diagnosis, 
treatment and placement developed 
because specialists experienced difficulty 
in working alone with many handicapped 
students (Fearn, 1971, Vocational 
Evaluation and Work Adjustment Association, 
1975). The team concept offers a 
broader view and inputs different 
perspectives to the education and 
rehabilitation process. Creative 
interaction of team members will help 
those professionals playing pivotal 
or primary roles to perforin better 
in their own job and help them to 
ca r ry out or faci 1 i tate carry i ng out 
of tasks important to other professionals 
working with the same students. 

Students Nee.iS 

The need for extra help and support 
is usually greater with students having 
disabil ities and vocational rehabilitation 
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services can be most helpful with 
this population in a ::hool setting. 
The vocational rehabil itation counselor, 
vocational eval uator , and work adjustment 
special ist functioning in or with 
schools systems do work closely and 
.viore precisely with older students. 
They focus cn and offer supportive 
services to older students and they 
work closely with teachers and other 
staff who have younger students who 
<^ay 1 ater experienci ng d i f f icul ty 
in making the transition from school 
to work. 

Consul ting 

In a school setting the vocational 
evaluator and the vocational rehabili- 
tation counselor function often as 
consultants to teachers and to other 
school staff. Several assumptions 
support this consulting role for 
the rehabi 1 itation special ist. The 
most important assumpti on is that 
the consultant is fully traineci and 
experienced in the areas where consulting 
will be provided. Also, teachers 
and other professional staff in che 
school setting will already own many 
special skills, knowledges, and related 
kinds of information and problem 
sol ving abil ities related to many 
jobs and kinds of work. They will 
know about curri cul urn devel opment , 
teaching strategies % situations sur- 
rounding students , other teachers , 
the school and the commun i ty . As 
a result, many highly qualified pro- 
fessionals stand ready to assist 
the vocational eval uator and the 
vocational rehabil itation counselor 
in their part of the rehabilitation 
process. A minimal amount of training, 
a little extra time and a few special 
tools may serve tc make these profes- 
sionals val uable vocational rehabilitation 
team members as wel 1 as speci al teachers . 

A consul tan t in pre /ocati onal 
eval uat ion shoul d provide or hel p 
others provide the following: 1) 
def i ne student prQbl ems i n the 1 i ght 
of labor market needs, evaluation 
tools and trai ni ng possi bi 1 i ti es ; 
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2) Help student to set realistic edu- 
cational and vocational goals and 
objectives in relation to the world 
of work; 3) sel ect appropriate measurement 
tools for individual students; 4) 
seek out and reinforce input from 
fellow team workers; 5) provide vigorous 
school-related analysis and syntheses 
of student data and work data; 6) 
indicate possible or probable vocational 
outcomes and benefits; 7)identify 
and describe worthwhile alternative 
approaches to problem solving 8) provide 
meaningful cost-benefit analysis where 
appropriate; and 9) identi fy barriers 
to constraints on alternatives to 
student attainment of work related 
objectives. Since special education, 
vocational rehabil itation, and vocational 
education problems are often very 
complex, teamwork is a must in this 
prevocational process. Because of 
the complex problem and team effort 
it is very important that consultants 
be flexible and supportive of other 
team members. The results can be 
most gratifying. 

Consultant Preparation and Activities 

The vocational evaluator or vocational 
rehabilitation counselor hired as 
a consultant can be either in-house 
with responsibilities toward many 
students and staff peopl e or the consultant 
may be hired part time from cutsid^ 
to assist with more complex work-related 
student problems and to guide or fill 
in at select spots in the vocational 
rehabilitation process. In the prevo- 
cational school setting, the consultant 
may play the role of a technical expert 
who possesses considerabl e knowl edge 
and expertise that may take a fair 
amount of time for someone else to 
learn and additional time to ksep 
new knowledges up-to-date and the 
skills sharp and available for immediate 
application. The qualified consultant 
should also play an increasing role 
as a facilitator to prevocational 
problem solving by other school profes- 
sional staff. In the latter situation 
there may be frequent calls for expert 



knowl edge and techni cal experti se 
but the consultant would spend more 
time bringing in technical resources 
and 1 earning aids and in doing in-service 
training with direct service staff. 

The resources and training consultant 
approach has the advantage of allowing 
the consultant to serve more clients 
through other professional s (i.e., 
teachers, counselors and psychologists) 
who al ready possess a number of important 
vocational rehabilitation skills. 

The on-site school people are 
invaluable to the prevocational process 
and thei r expertise and observation 
must be utilized in vocational assess- 
ment . They are al ready there , they 
have to be there all day (at least 
the teachers do) and they are already 
partial ly trained. Therefore, they 
can function well with only a limited 
amount of special i zed training. 
High qual ity prevocational eval uation 
can result in using but a 1 i mi ted 
amount of extra teacher time and 
a limited amount of consultant time. 
Thi s approach can work wel 1 and it 
is a cost effective process. 



Some Administration Issues 

Rehabil itation counselors and 
vocational evaluators in a school 
setting often find they are providing 
or can provi de overl apping services 
to other rehabilitation and educational 
staff and to students with disabil i ties . 
This overlap can be a strength as 
long as professional s i n both groups 
are aware of the overlap and are 
respectful of each other. This overlap 
is or can be true for two reasons: (1) 
Members of both professions will 
have had strong training and experiences 
in: utilization of occupational infor- 
mation , worki ng wi th di sabl ed peopl e 
who have functional limitation and 
dealing with disabled people in work 
experience programs. (2) the organi- 
zational structure and administration 
staff of the prevocational program 
in the school setting supports the 
team effort. 
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Rehabil itati on/evaluation profes- 
sionals may fit into the school organi- 
zation in a variety of ways depending 
on the community, the school and local 
resources. State office of vocational 
rehabilitation counselors or evaluators 
may be assigned to the school or terri- 
tory. Private consultants may be 
hired as needed or these professionals 
may be hired as school employees. 
Whatever the arrangement, the potential 
benefits for the student are substantial . 
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A HIERARCHICAL MODEL OF VOCATIONAL 
EVALUATION: FLEXIBILITY MEANS BETTER 
SERVICE 



VICTORIA ANNE MASON 



ABSTRACT: The evolution of vocational 
evaluation is such that there is a 
greater need for flexibility. This 
need is created by the greater variety 
of people being served; by the creation 
of profit-based vocational evaluation 
establishments and the private practicing 
vocati onal eval uation special is ts; 
and by the need for more cost-effective 
service capabilities. This article 
presents a Hierarchical Model for 
vocational evaluation as one systematic 
approach for meeting this need for 
fl exi bil i ty . 



In the past, the predominant 
use of work samples by vocational 
eval uation programs was considered 
to be an enl ightened method for assessing 
the vocational needs and skills of 
disabled people. Now, work samples 
are frequently viewed as cumbersome, 
of questionable va 1 idity, time-consuming 
and expensive, Additionally, there 
are many factors which have not only 
changed the nature and use of work 
sampl es themsel ves , but have also 
caused subtle changes in the concept 
of vocational evaluation and have 
created new approaches cr improvements 
on tradi tional approaches . These 
factors include the introduction 
of the computer, the task-analysis 
a pp roach for job-structur i ng , the 
devel opment of standardi zed tests 
normed on populations of mentally 
retarded i ndi vi dual s , the emphasis 
on vocational drvel opment : , n special 
education, availability ,v; vocational 
rehabilitation to worker's compensation 
reci p'entc , and the need to improve 
job placement for >.1TPA clients. 

Tie results of these influences 
re qui res voceti onal eval uati on to 
reference itself less to one approach 
and ore type of popul ation and more 
to the ability to match the approach 
to the i ndi vi dual cl ient . Thus , 
vocational eval uation wil 1 expand 
away from the u voc eval unit" of 
the speci al educat i on program and 
the rehabilitation facility. During 
the next ten years there should be 
a surge of private practicing vocational 
evaluators and profit-based vocational 
eval uat ion establishments, which 
wil 1 serve disabled and no n- disabled 
popul at ions . Additional ly, publ ic 
rehabilitation agencies will require 
greater f 1 exi bi 1 i ty of assessment 
approaches at different fee structures 
to promote cost-effectiveness . Most 
importantl y , vocational eval uation 
programs wil 1 be more f i exi bl e in 
the way they may serve their clients „ 

Hierarchical Model 



The successful appl ication of 
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vocational eval uation/assessment shal 1 
depend on how well the program relates 
to the needs of the individuals being 
served. A flexible system for meeting 
these needs can be created throuoh 
a vocational assessment/ eval uation 
menu. This menu consists of a hierarchical 
model of vocational evaluation/assessment 
"packages. 11 The basis for the hierarchy 
is the level of comprehensiveness 
of each program package. Generally, 
the more comprehensive the eval uation/- 
assessment , the more time-consuming 
is the package. Table 1 outlines 
the Hierarchical Model of Vocational 
Eval uation . 



which imposes specific 1 imitations 
while not having broader implications 
to other areas of skills, aptitudes, 
or interests. 

Exampl e 

Jim Smith, who . r suffering 
from Carpal funnel Si- <rcme , may 
need a thorough evaluation functional 
manual and finger dexte*" skil Is., 
for the purpose of detenir^ing th'i 
feasibility of placement as a r..., or. 
Dexterity tests and a cashie. v 
sample rr- v be administered. 



TABLL 1 

SUnnARl DESCklFTIOf* 0E KlERAkCHlCAL MODEL Of VOCATIONAL EVALUAY . 



•FEATURE 

I time 

I PURPOSE 



| ASSESSMENT 
I APPROACHES 



I APPROPRIATE 
| REFERRALS 



I I 

I | TRANSFERABLE SKILLS 

I SPECIALIZED ASSESSMENT | ASSESSMENT 

, | ,,,,, » Uttiliil I ■liill.ll| ll(allL I|la 

I Few hourt to 2 dayt, depends | One lo 6 hour*, depending 
|on ihe n»u*(i) addretted [«?n coapuler capability 



I I 

I (SHORT-TERfl 

I ONE- DAT VOCATIONAL ASSESSflEH | VOCAT JONAi. EVA.<. 

|ii*t(iiittini«cii ( i( jaitetis it* ■ 

|Tuo lo five da/s 
I 



| Four lo Seven Hour* 
.1. 



.|... 



I «ki 1 ts area; behavior nol 
|*pecifically addretted. 



|Eilh*r lo att^ftt tullv «vJ 
Ibehjvior. related to a 
(occupation, and/or lo 
lobterve tpecific bchaviorv 
land work lolerancet. 



|Choice of Irslins approach 
Idependt on Ihe reason for 
Ireferral 



ITo IhoroMShly »nd adequ,l.ly|To delereine occupational | to obtain a worker profile 
(attest one or two tpecific | alternative* bated on pttl |/ 0 r Ihe delerainalion of 
|work hitlory, cate recordt, |coepliaenlary vocational 
land/or client interview lalternalivet 

• I 

I; I 

|C*te review, interview, and | Standardized lettt, toae 
|lhorbu9h analytit of work |work taaplet. interview, 
l hl * lor y> Him led behavioral obter 

'J I |vation, 

I Individual for who. ihe ,ob| Individual! yhi have'a lig-lcilinrwllh'^adi^'iklli 
jplaceeer.l .ay depend on |mfic»nl « 0 rk hitlory and |al fclh 9 rade ein.aue. fnr 
Iwhelher or nol Ihe pretence | for whoa l.ttins it nol (whoa behavior and phy^-a 

il?»IE lflC b ' ! ,pPr0pr,,l, Itol.ranc.t are cither well- |,prn,li,ed U^-cont^in, 

confirBM * I Idefined or nol a ( nn, f ic*m \ 

I llttue. t 

■' 1 i i 



(Interview, ttandardi^d lettt,' 
and|wurk taaplet, tilualional 
lattetternt, on-the-job 
| evaluation. 



(LONG-TERM 

| VOCATIONAL EVALUATION 

* |>iiii»ii ■■■■■xtnit 

STwo to tlx weeks 



jTo deleraine trw rduraliona) , 
(occupational, and rehabili- 
tation potential with 
■eaphatit on behaviort, habilt 
land work tolerances. 



.1. 



| Individjalt w ;lh ainiaal or 
| functional acadeaic tklllt 
land ainiaal need frr 



^'tettacnl approachet. 



|£'«li»i heavily on situational 
lattettaenl and work taaplet. 

I 
I 

.1.... 

I indivKf jalt who are urverely 
;ditabled and for v.icj fittwt- 
(behavioral lttuet are a aain 
Iconcern and/or epecial 
Ilrchniquet autl be uted. 
I 



.1. 



Specialized Assessment 

The purpose of this assessment 
is to thoroughly study a specific 
issue or two. This evaluation may 
be needed to determine the appropriateness 
of a job placement or the functional 
extent of a disability. The Specialized 
Assessment may use standardized tests 
and/or work samples, depending upon 
the issue being addressed. The time 
needed for this assessment could vary 
from one hour to more than a day; 
again, it depends on the issue addressed. 
The Special ized Assessment is appropriate 
for individuals who may have a disability 



Transferable Skills Assessment 

The purpose of this assessment 
is to determine occupational alternative 
based on i n formation obtained from 
the work history, case record, ^nd/or 
client interview; this based on the 
premi se that a person demonstrates 
certain aptitudes, skills, and interests 
through a successful work hi story. 
Therefore, by adjusting the worker's 
"profil e" to accommodate to the functional 
limitations imposed by the disability, 
potent i al occupational alternatives 
can be determined. This is the premise 
of the computerized occupational 
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matching systems and the VDAKE process. 
The amount of time vary from one 
hour to six hours, depending on access 
to computer pro-ams. This type of 
assessment is often used by rehabil itation 
counselors to determine the evaluatiof 
needs of the client. Additionally, 
it is frequently applied to legal 
situations and to the vocational evaluation 
of industrially injured workers. 

Exampl e 

Jim Smith ' s rehabil itation counselor 
or vocational eval uator may have determined 
the need for the Specialized Assessment 
by having done a Transferable Skill s 
Assessment. 

One-Day Assessment 

The purpose of this assessment 
is to obtain a "worker profile" of 
skills, aptitudes, interests, and 
valuer, which is the basis for the 
determination of compl ementary vocational 
al ternati ves . It di f fers from traditional 
vocational evaluation by not "utilizing 
work" and by relying primarily on 
standardized instruments. It does 
not comprehensively address work toler- 
ances, behaviors, and habits. This 
assessment usually requires one day 
of testing (anywhere from four tc 
seven hours), and it relies primarily 
on standardized tests, client interview, 
and review of the case records. Work 
samples are used minimally and behavioral 
observations made usually result in 
limited implications. 

Appropriate referrals are those 
individuals who 1) have a 6th grade 
or better reading skills, 2) are of 
borderline to average intelligence 
or better, 3) have work tolerances 
well established by other means or 
disabilities that do not significantly 
affect physical functioning, and 4) 
have behaviors or work habits that 
are not of concern. 

Exampl e 

Mary Jones wants to drop-out 



of school but has idea what kind 
of work she can get. Her teacher 
would like her to enter the vocational 
education program and wonders which 
trai ni ng curri cul urn voul d be best 
for realistically cour^eling Mary. 

Short- r *na Vocational Evaluation 

The overall purpose of the Short-Term 
Vocational Evaluation is to assist 
the individual and the counsel or/ teacher 
wi th vocational planning. However, 
emphasis also may be placed on assessing 
skill , behaviors and work tolerances 
specific to an occupation or determining 
a "worker profile," as well as addressing 
issues of work tolerances, behaviors, 
and habits. The time needed for 
this assessment i s general ly two 
to five days. All approaches of 
vocational evaluation may be ised, 
wi th some emphasi s on the use cf 
work sampl es . Appropriate referral s 
are usually those individuals with 
minimal academic skills and a minimal 
need for the more t <me-consumi ng 
and special ized vocational eval uatior 
approaches, such a;; situational assess- 
ment. 

Exampl e 

John Ca f .)ot is interested in 
becoming a mechanic ana has a learning 
disabil ity . Thi: eva : nation would 
focus on the skills, aptitudes, etc., 
re qui rements for mechani cs . Stan 
Davis has first ^ra^e reedii.g skills 
and has chronic c $ teoniyel i ti s as 
a result of a leg 'racture , His 
eval uation woul d focus on the deter- 
mi nati on of appropr i a te vocational 
goal alternatives and hi r vocationally- 
related needs to enable the development 
of a successful rehabilitation plan. 

Long-Tena Vocational Eval lotion 

This assessment is a traditional 
vocational evaluation, designed to 
determine the occupational, rehabili- 
tation, or educational potential 
and needs. Particular emphasis is 
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placed on work tolerances, behaviors 
and habits, ant. 4 special needs to be 
addressed in che rehabilitation or 
educational plan. This type of assessment 
is the most comprehensive and allows 
the client to receive hands-on experience 
or preliminary training to prepare 
for assessment with work samples. 
It makes extensive use of situational 
assessment, work samples, and other 
special i zed vocational evaluation 
techniques. Individuals who benefit 
from this assessment form incl ude 
those who have severe disabilities 
that affect several skills areas or 
for whom behavioral issues are a primary 
concern , 

Example 

Cathy Rai nes suffered a closed 
iiead injury which has affected her 
language and motor skills as well 
as her behavior. Her evaluation would 
focus on the vocational impact of 
itese limitations and more thoroughly 
assess the functional extent of these 
1 imitations. 

Implications for the Future 

The evolution of vocational evaluation 
from a historical perspective indicates 
that the dependence upon work samples 
and "traditional" long-term vocational 
evaluation is not appropriate to all 
disabled individuals. Moreover, vocational 
evaluation has applicability not only 
outside the state-federal' vocational 
rehabilitation program, but also outside 
the disabled population. Many factures 
have been influential in. this evolution. 
Additionally, current economic restraints 
on vocational programs require that 
vocational eval uation special is ts 
provide cos t-ef feet i ve al ternati ves 
that better meet the needs of the 
people they serve. 

The Hierarchical Model of Vocational 
Evaluation enables the vocational 
evaluation special ist to more effectively 
select vocational evaluation approaches 
and techniques that meet the needs 
of the client. The vocational evaluation 



specialist can also offer a cost-effective 
vocational evaluation service to 
meet the needs of the referring agency, 
counselor, or teacher. The Hierarchical 
Model additionally enables the vocational 
eval uation special ist to incorporate 
the new or improved vocational evaluation 
techniques and approaches into program 
capabilities. The future evolution 
of vocational evaluation centers 
on three areas of concern: 1) The 
willingness to abandon the philosophy 
that onl y time- ho no red methods of 
vocational eval uation programs can 
meet the needs of all disabled people, 
2) the access to private-practicing 
vocational eval uation special is ts 
by both disabled and nondisabled 
individuals, and 3) The ability to 
provide greater flexibility in meeting 
the needs of the client/student. 
Thi s Hierarchical Model addresses 
all three areas of concern, of which 
the need for flexibility may be the 
greatest. 
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SHORT TERM TRAINING OF VOCATIONAL 
ASSESSMENT PERSONNEL: KEEPING APACE 
WITH THE CHANGING PROFESSION 



COLLEEN FOX ESSER 



ABSTRACT: Training is an important 
professional issue. Because of the 
growth and diversity of the field, 
the shrinking of federal support, 
and an increasing demand the field 
of training is becoming increasingly 
complex. This paper looks at some 
of the most relevant training issues 
for the field of vocational assessment. 



In 1975, the vocational Evaluation 
and Work Adjustment / jsociation (VEWAA) 
published the Vocation 1 Evaluation 
Project Final . sport , tile culmination 
of a three-year study which was sponsored 
by VEWAA and funded by a grant from 
RSA . The purpose of the project 
was to "attain and pub! ish a professional 
consensus" with respect to a number 
of areas of concern in the field 
of work evaluation. The task force 
involved identified: the uni que 
features, processes, and tools of 
work evaluation; the skills needed 
to provide work eval uation services; 
and the target population that such 
services could effectively serve. 
In addition, the study addressed 
the need for development of standards 
for work evaluation services, and 
attempted to define the role of the 
professional eval ua tor . The Final 
Report was a document which described 
the "state-of-the-art" of vocational 
evaluation at the point in time and 
served the f i el d wel 1 in terms of 
defining and clarifying concepts 
and in rai si ng important i ssues of 
our profession. 

Now, in 1984, VEWAA has undertaken 
the sponsorship of another "state-of- 
the-art" project in the form of the 
National Forum on Issues in Vocational 
Assessment." Although the same types 
of demographic de ta will not be generated 
by the conference as was by the 1975 
study, it is interesting to note 
the topics being prese ted as current 
i ssues and to make i ,me comparisons 
with the issues o 1975. 

The first section of the 1975 
study took a 1 ook at vocational evaluation 
in the human services delivery system, 
but dealt almost exclusively with 
it as a service of the state vocational 
rehabilitation services system. 
Much discussion was devoted to defini- 
tions , go*l s , and objectives of vocational 
eval uation. 

Today, 1984, there is still 
a concern with the development of 
vocational assessment theories, models, 
and appl i cations , with the provision 
of qual ity services i n an effective 
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and efficient manner, and with the 
need for the continued development 
of a body of knowledge and research 
activities to validate our methods. 
Today our profession has expanded 
into many new areas of service and 
vocational evaluators are now found 
in settings somewhat different then 
nine years ago. Thus the demand for 
better research is even more critical 
than in 1975. 

In an attempt to identify a "typical" 
client, the 1975 study collected data 
which showed that 64% of the clients 
served were referred to facilities 
by the state vocational rehabilitation 
agency and the primary handicapping 
conditions of clients served was mental 
retardation. Although similar data 
is not available today, it is certain 
that there is much greater diversity 
in our clientele. Vocational evaluators 
are now assessing school-aged populations 
as well as elderly persons; clients 
with closed head injuries, chronic 
mental illness, learning disabilities, 
chronic mental illness, learning disabil- 
ities, chronic pain, and industrial 
injuries. Follow-up of recent graduates 
of Stout's Master* s program find many 
still employed in rehabilitation facili- 
ties; however, others ?re now working 
secondary and post-secondary school 
setti ngs , correctional institutions , 
in private- for-profit rehabil i tation 
agencies, insurance companies, hospitals, 
and private industry. 

Finally, the VEWAA study took 
a look at the role of the vocational 
evaluator and generated some descriptive 
data on persons in the field at that 
time. In 1975, ?nost vocational evaluators 
were hired with little or no formal 
training in vocational evaluation. 
Most were trained either through short 
term training, in-service training, 
or by a method referred to as a "learn- 
whi 1 e-you-earn OJT." Eighty seven 
percent of the survey respondents 
worked in private non-profit rehabilitation 
settings. Certification of vocational 
evaluators was suggested as a means 
of upgrading the profession. 



The greater variety of setti ngs 
in which eval uators are em pi oyed 
today has a 1 ready been menti oned , 
but it would appear that r.any practicing 
vocational evaluators in rehabil itation 
facilities are still not formally 
trained, at least not at the Master's 
level. The variety of settings arid 
opportunities for graduates of existing 
pre-service programs has made it 
difficult to meet the demand in the 
field. 

The VEWAA Study of 1975 was 
important in i denti fyi ng issues of 
an emerging profession. It also 
documented the need for training 
of vocational evaluators and helped 
traini ng programs such as Stout's 
short-term training program structure 
the content of their programs. Training 
is still an important professional 
issue today. However , gi ven the 
growth and diversity of the field, 
the diminishing federal resources , 
and increased demand for training, 
it is a more complex issue and needs 
to be careful ly loo keu at. The remainder 
of this paper will address some of 
those training issues for the field 
of vocational assessment. 

Settings 

School -Based Assessment Programs 

Vocational evaluation in school s 
was minimally addressed in the 19/5 
VEWAA Project Final Report . However , 
in one section which summarized comments 
by leaders of related fields, school 
personnel expressed somewhat of an 
interest in the evaluation process 
and encouraged further devel opment 
and communi cation . Interestingly 
enough, one Office of Education repre- 
sentative suggested that the term 
vocational evaluation should be replaced 
by vocational "assessment" or "appraisal ." 
In general, however, evaluation in 
schools settings was minor area of 
concern. 

Obviously, times have changed. 
Issues related to assessment in schools 
are of major concern to the 1984 
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conference. Legislative mandates 
as well as changes in philosophy and 
consumer expectations have caused 
both secondary and post-secondary 
educational institutions to identify 
and provide for "special needs' 1 of 
their disabled students. The need 
for better assessment capabilities 
was recognized by school personnel 
who found that vocational programming 
was far more complex when severe disability 
and societal attitudes toward disabilities 
were considered (Stewart, 1980). 

To date, many states have developed 
model s of vocational assessment for < 
their special needs students, and 
the federal emphasis during the past 
four years on "transition-from-school - 
to-work" suggests that many more states 
and/or school districts will be studying 
vocational rehabil itation and vocational 
evaluation techniques in order to 
adapt them effectively to their needs. 
McDaniel in Volume VIII, Number 6, 
of Rehabil itation Brief , stated that 
the Commission on Certification of 
Work Adjustment and Vocational Eval uation 
Specialists (CCWAVES) estimated that 
the potential for certified vocational 
evaluators is eight times higher in 
school setting than in rehabilitation 
settings. 

The issues for training become 
quite obvious and, indeed, somewhat 
overwhelming. As with rehabilitation 
facilities, some school systems will 
hire trained, certified evaluators, 
where many other will rely on in-service 
and short-term training to upgrade 
the skills of existing staff. 

Noll ( 1978) found that tasks 
performed by evaluators in the schools 
he studies were virtually the same 
as those performed by evaluators in 
rehabil itation facil ities. However, 
certain knowledges and skills are 
critical and need special emphasis 
in training school -based evaluators. 

For exampl e , servi ces i n school s 
are general ly designed to facil itate 
the career devel opment process ( Rehabil i- 
tation Brief , April, 1983). Assessment 
programs must be developed along a 
career development model rather then 



a medical model as often happens 
in vocational rehabilitation services. 
Evaluators must understand the various 
stages of career development in order 
to develop appropriate assessment 
strategies to address needs of specific 
age groups, for example 7th graders 
as opposed to 12th graders.- 

Training programs must also 
ta ke into account that school -based 
eval uators work with numerous other 
parties aside from their students 
who may not be familiar with vocational 
assessment techniques. They must 
be able to explain evaluation results 
to teachers , both special and vocational 
education, counselors, administrators, 
pati ents , work study coordinators , 
etc. Evaluators in schools are also 
part of a mul ti-di sci pi ina ry team 
who all contribute to the development 
and implementation of the IEP. Team 
building, probl em-sol vi ng and superior 
communication skills are then required. 

Vocational ex pi oration activities 
are an extremel y important part of 
school -based assessment programs . 
School evaluators need thorough knowledge 
of occupational i nformation resources 
and vocational, exploration systems. 
A knowl edge of community resources , 
and a thorough understanding of occu- 
pational requirements and trends. 

School -based assessment programs, 
parti cul arly those 1 oca ted i n post-- 
secondary settings, often are used 
to identi fy appropriate vocational 
trai ni ng program choices or al terna- 
tives. Evaluators are asked to assess 
skills, abilities, and interests 
in re 1 at i on to *;xi sti ng vocational 
training programs. Thus, an understanding 
of vocational education in general , 
as wel 1 as requi rements of speci f ic 
vocational education programs i s 
a needed competency. 

Peterson ( 1981 ) suggest that 
well trained evaluators can promote 
cost effectiveness in school programs 
by developing 1 ocal work sampl es 
and using existing school resources 
rather than purchasing expensive 
commercial vocational evaluation 
systems. Training programs may need 
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to place extra emphasis on work sample 
development and norming procedures. 

Trainers of school based evaluators 
must be aware of the variety of school - 
based models. HcCray (1982) describes 
six model s: 

1) Assessment in special education 
classrooms 

2) Assessment in occupational 
exploration classes 

3) Integrated vocational assessment 

4) Vocational evaluation center 

5) Contracted vocational assessment 

6) Mobile evaluation units 

Although evaluator comoetencies are 
fairly constant across programs, each 
model presents differing problems 
and concerns. 

In summary, school based assessment 
program:; and the needs of evaluators 
in those programs offer a variety 
of training issues to be considered. 
Certainly, there are others not mentioned 
here, but in general the literature 
suggests that such evaluators reed 
to develop competencies ^ n the general 
area;- required by CCWAVES certification. 
However, they also need an understanding 
of career devel opment , special education , 
and vocational education (Peterson, 
1981); knowledge of federal legislation 
as well as local resources and concerns: 
team work ability; and ability to 
adapt traditional vocational rehabilitation 
practices to a school population and 
settings. Short-term and in-service 
training programs should be designed 
accordingly. 

Private Sector 

It is not surprising that "private- 
for-profiu" rehabilitation was not 
mentioned in the 1975 Final Report. 
The growth of the field of private 
practice in rehabilitation has been 
one of the major developments of the 
1980's , and where the vocational evaluator 
f i :s into this field certainly is 
one of the more interesting issues 
to be discussed. The Fal 1/1983 VEWAA 
Bulletin devoted an entire issue on 
private practice of vocational evaluation 
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and in it a number training issues 
emerged. 

In her introductory comments, 
Ellis (1983) expresses a concern 
for the lack of preparation for evaluators 
offered by pre- service training programs. 
Sink and King (1983) state that there 
a "few eval uators in the pr i vate 
sector who devote ful 1 time to vocational 
evaluation", and suggest a private 
sector evaluator needs skills and 
competencies common to both evaluators 
and counselors . 

Mason ( 1983 ) addressed work 
eval uation from an industrial perspective 
and suggests that rehabilitation 
specialists in the setting need training 
i n human resource management, labor 
relations, prevention and safety 
ma nagement , and general business. 
Articles by May and Brandon (1983) 
address the vocational eval ua tor 
as an expert vocational witness which 
raises questions of what skills are 
needed in the courtroom. The diversity 
of viewpoints reflects the scope 
and diversity of issues surrounding 
private practice rehabilitation. 

As a professional involved in 
short-term training of evaluators 
for a number of years, I can recall 
few i ssues of more controversy than 
that of the role of federally funded 
training programs in the training 
of practi ti oners for t he pri vate 
sector. Aside from the obvious issues 
of needed competencies and required 
modi f ications of technol ogy and process , 
the greater question has been' where 
and on whom should we expand our 
limited training resources. On the 
one hand, there is still, and wili 
be for some time, a great need for 
trained evaluators for the traditional 
rehabil i tat ion faci 1 ity settings 
(Menz, 1983). On the other hand, 
the demand and market is there for 
training of private practice personnel. 

The Research and Training Center 
at Stout has chosen to focus i n i ts 
training efforts in this area on 
evaluators in rehabilitation facilities 
who are assessing industrially injured 
workers referred by pri vate practi ce 
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rehabilitation specialists or insurance 
companies. These evaluators generally 
have had experience working with the 
more traditional facility clientele 
and evaluation programs and are now 
dealing with a different population, 
referral sources , and expectations. 
Our needs assessment for this program 
suggested training in the f ol 1 cwi ng 
areas: 

- Understanding of private sector 
rehabil itati on/workers compensation 

- Adaptation of traditional 
evaluation tool s for industrially 
injured 

- Shorter term evaluation 

- Job modification and job restruct- 
uring 

- Vocational expert testimony 

- Marketing evaluation services 

- Communication skills 

- Working with employers 

Rehabilitation Facilities 

Even though it is exciting to 
see the changes in our profession, 
it is important to remember that tradi- 
tional rehabilitation facilities are 
stil 1 the primary empl oyers of vocational 
evaluators. In his 1983 study of 
Manpower Needs in Rehabilitation Facili- 
ties: 1980-1990 9 Menz projected that 
there will be a 97% increase in demand 
for evaluators in facilities by 1990. 
Even without the expansion into other 
settings, the implication of these 
projections for training resources 
is challenging to say the leest. 
Newly funded pre-service trailing 
at the graduate level will certcinly 
provide for sorce of the need. However, 
sheer numbers i nc!i cate a conti nued 
need for "fundamental s n training for 
facilities who are unable to hire 
graduate evaluators „ Ba^ic short-tern 
pro grams muse conti nue to be offered 
to train evaluators in the vocational 
eval uation process , tool s , and techniques. 
Such training continues to be a high 
priority for Stout RTC. However, 
as the field matures and expands, 
we have found that training needs 
for experienced vocational evaluators 



must also be addressed. The following 
sections will address some perspectives 
on those needs. 

Issues of New Client Populations 

Just as the setting for vocational 
evaluation services has changed since 
1975 , so has the cl ient populations 
with which we deal. Participants 
in all of our short-term training 
programs are asked to complete a 
"problem identification" for indicating 
speci f ic cl ient or program problems 
they wish to discuss in the training 
program. These forms along with 
requests from the field for specialized 
training const i tute an i nformal , 
continuous needs assessment for our 
programs . A number of issues and 
trends have emerged from these requests. 
A client population which appears 
to be of concern to our participants 
at present are those with traumatic 
head injuries. Dealing with the 
complexities of assessing such a 
popul ation is certainly an important 
issue for short-term training programs. 

In an excellent and informative 
article in the Spring, 1983, VEWAA 
Bui 1 eti n , "Issues Relevant to the 
Vocational Eval uation of the Trauma- 
tically Head Injured Client," Musante 
suggests that the primary probl ems 
of assessing this population are: 

1) Difficulty in estimating 
function given inconsistencies 
in performance 

2) The expression of anger as 
a natural react ion to the 
evaluation process 

3) Inherent probl ems in using 
standardi zed tests and work 
samples 

4) The need for non-static evalu- 
ations over a longer period 
of time. 

Musante suggest that it is more 
important for evaluators to assess 
abi 1 i ty to compensate for deficits 
than to make speci fic empl oyment 
recommendati ons and stresses that 
a "team approach" is essential as 
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well as creativity and problem-solving. 
Evaluators working with this population 
have been able to find relevant training 
in the medical aspects of this disabil ity, 
but not as often in vo cational aspects, 
especially effective assessment tech- 
niques. Addressing these needs will 
require a "pooling" of knowledge between 
those with medical expertise and those 
with vocational skills and knowledge, 
as well as an identification of practi- 
tioners who on a day-to-day basis 
are discovering suitable methods and 
technology. 

Another client population which 
is of special concern to our participants 
are those persons with chronic mental 
illness. As with many severely disabled 
persons, experienced evaluators suggest 
a multiplicity of techniques and a 
team approach. Beley and Felker (1981) 
developed a program which required 
close cooperation between psychologist 
and evaluator and a combination of 
assessment tools, in a three week 
evaluation to answer referral questions. 
Issues identified by the authors include 
the need to observe behavior over 
a period of time due to the variability 
of the effect of chronic mental illness 
on behavior, dealing with societal 
fears; and the effects of secondary 
manifestations of the disability such 
as passive dependent behavior (earned 
in an institution. 

Cubelli (1970) feels that it 
is the attitude of rehabilitation 
workers which becomes critical. "The 
tendency of mental patients to regress, 
recompensate, and regress again" can 
be extremely disconcerting to the 
evaluator. Evaluators who have been 
trained to assess objective data, 
Cubelli states, must also be ready 
to evaluate more subjective forces 
which he terms "readiness to work." 
In other words, assessment of motivation 
and ability to function independently 
and relate to others takes precedence 
over assessment of work skills. 

Evaluators who work with these 
disability groups as well those who 
work with individuals who are learning 
disabled or severely developmentally 



disabled require training focused 
not only on assessment techniques, 
but on the use and modification of 
those techniques to effectively serve 
their clients. In some cases, we 
have included units to address these 
concerns as part of our regul ar programs . 
Others, such as assessment of closed 
head injury clients will require 
a free-standing program to deal effec- 
tively with the complex issues. 

In any assessment program which 
deal s with cl ients who are severely 
handicapped , training programs need 
to emphasize teamwork. Interestingly 
enough, the 1975 report devoted a 
whole section to "the Evaluator Team 
Approach" stressing the eval uator' s 
need for skills in communications, 
group dynamics and group decision-making. 
Agai n and a gai n in the revi ew of 
literature for this paper, the concept 
of teamwork was emphasized for effective 
assessment and rehabilitation programming 
of severely disabled clients. 

Issues of Professionalism 

Much has been wri tten since 
1975 regarding the "professionalism" 
of vocational evaluators particularly 
over the issue of certification. 
Amid discussion regarding the presence 
of a systematic body of knowledge, 
professional authority and culture, 
and ethical codes, the certification 
process was established and is now 
a reality. At present more than 
580 person are certified as vocational 
evaluators as the grandfathering 
period comes to a close. Now in 
1984, the question is no longer whether 
or not we are a profession, but how 
to enhance that professional i^„i. 
Training can be i nvol ved in that 
enhancement in a number of ways. 

Of course, the obvious is that 
trai ning (hopeful ly) upgrades skills 
of practitioner and thereby improves 
the services provided to handicapped 
i ndi vi dual s , a primary profess ional 
concern. As certi f ied eval uator s 
need certification maintenance, it 
will be important that training resources 
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are ready to provide quality training 
which meets CCWAVES maintenance require- 
ments as well as professional evaluator 
needs. 

In 1981, the Stout Research and 
Training Center training programs, 
recognizing the need for advanced 
training, surveyed past participants 
to determi ne advanced trai ni ng needs . 
Topics suggested were consistent with 
those being dealt with in the 1984 
Issues Forum. Some of these were: validi- 
ty, reliability and norming of work 
samples; use of vocational evaluation 
tools with severely disabled; assessment 
of learning styl es ; rehabi 1 i tati on 
technology; program evaluation; private 
sector rehabil itation; and communications 
skills. Although many topics were 
initially offered in a single program, 
it was determi ned that most topics 
needed to be offered in more depth 
in separate, 'free-standing seminars. 
One of these "advanced" programs is 
the "Assessment and Placement of Indus- 
trially Injured" program previously 
mentioned. 

All of these considerations point 
up the critical need for training 
at an advanced level for professional 
evaluators. As the field grows and 
changes, issues such as those discussed 
in this paper and at this conference 
need to be addressed through high 
level, advanced training seminars 
utilizing experienced professionals 
who are actively involved in the pro- 
fession. As the field becomes more 
complex and sophisticated, training 
personnel must work more and more 
to identify experts in our field who 
are willing and able to share their 
expertise with their colleagues. 
To this end, the Stout RTC has developed 
a roster of adjunct facul ty who are 
either field practitioners or faculty 
from other academic setti ngs . These 
adjunct persons are util ized according 
to their expert i se , avai 1 abi 1 i ty , 
and seminar location and have helped 
immensel y in the development of our 
advanced training programs, as well 
as to supplement our staff for fundamentals 
programs. 



Another issue of professionalism 
is in the area of research. At present 
thirty Research and Training Centers 
are funded by NIHR, four with a vocational 
emphasis. Leaders in the rehabil itation 
field have recognized the need to 
carry out research and to disseminate 
results to the practitioners. However, 
resul ts of research take a 1 ong time 
to reach practitioners and it is 
often i n a form unintel 1 i gi bl e to 
the everyday practitioner (and sometime 
to the everyday trainer!). Baker 
(1980) pointed out that "professions 
are developed over time by the shared 
knowledge of people engaged in a 
common area of interest and inquiry" 
and that "the application of knowledge 
(facts gained via the scientific 
process) is practiced more by profes- 
sionals than technicians/craftsman." 
Baker identified a concern that is 
at the core of the issue of profes- 
sionalism, and he went on to suggest 
that perhaps it is time to "expand 
our professional side through the 
development of theory related to 
the vocational development and adjustment 
of disabled persons." 

Training personnel have a respon- 
sibility to reinforce this goal for 
our profession by incl uding in our 
training programs relevant and timely 
research, by assisting to identify 
research issues through contact with 
practitioners , and by encouragi ng 
applied research by practitioners. 

In conclusion, I have attempted 
to identify and discuss some of the 
issues in trai ni ng of vocational 
assessment personnel. Certainly 
there are many mora issues which 
could be discussed in all of the 
areas mentioned. The areas with 
which I have deal t refl ect concerns 
expressed to the training staff of 
the Stout Research and Training Center 
by our program partici pants 3 by our 
National Advisory Council , and by 
other prof ess i onal col 1 eagues . The 
growth and devel opment of our profession 
provides training personnel with 
complex challenges and opportunities. 
It is important for us not only to 
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be aware or the issues and changes 
in our field, but to comrmicate closely 
with other training programs to meet 
those challenges most effectively. 
I appreciate the opportunity to be 
involved in the National Forum on 
Issues in Vocational Assessment and 
hope that this paper will facilitate 
dialogue with others who are concerned 
with trai ni ng i ssues in vocational 
assessment. 

REFERENCES 

Baker, Richard J. (1980). Research 
and Research Utilization - Try 
It - You Might Like It. VEWAA 
Bul letin , Summer. 

Bel ey, Walter and Felker, Sally (1981). 
Comprehensive Vocational Evaluation 
for Clients with Psychiatric Impair- 
ments, Rehabilitation Literature, 
42 (7-8.r 

Cubelli, Gerrd E. (1970). "Vocational 
Evaluation with Mentally 111 Clients 11 
in W. Pruitt (Ed.), Reading in 
Work Eval uation-I . Menomonie , 
WI : Stout State University, Institute 
for Vocational Rehabilitation. 

Ellis, Cindy (Fall, 1983). "Special 
Issues on Private Practice of Vocational 
Eval uat ion Editorial Comment" , 
VEWAA Bulletin . Fall. 

Mason, Jack D. (Fall, 1983). "Work 
Evaluation and Work Adjustment: 
An Industrial Perspective" VEWAA 
Bulletin , Fall. 

McCray, Paul M. (1984). Vocational 
Evaluation and Assessment in Schools 
Settings. Menomonie, WI: Research 
and Training Center, Stout Vocational 
Rehabilitation Institute, University 
of Wisconsin-Stout. Reviewed in 
Rehab Brief , Vol. VII, No. 6, 1984. 

Menz, Fredrick E. (1983). Manpower 
Needs in Rehabilitation Facilities: 
1980-1990 . Menomonie, WI: Research 
and Training Center, Stout Vocational 
Rehabilitation Institute, University 
of Wisconsin-Stout. 

Musante, Susan E. (1984). Issues 
Relevant to the Vocational Evaluation 
of the Traumatically Head Injured 
Client. VEWAA Bulletin , Spring. 



Noll, Allan and Ellsworth, Susan 
(1978) . "Vocational Eval ua tors 
in Schools Settings: Task Analyses, 
Certification , Qual i f i cat i ons 
and Status Study" Unpublished 
Master's Thesis, Stout Vocational 
Rehabil itation Institute, University 
of Wiscons inStout. 

Peterson, Michael (1981). "Deve- 
loping a Model of Vocational Assessment 
in Public Schools in Texas" VEWAA 
Bulletin , Fall. 

Sink, Jack M. and King, William M. 
( 1983 ) . "Evaluations Services 
in the Private Sector" VEWAA B ulletin, 
Fall. 

Stewart, William C. (1980). "In-Service 
Staff Devel opment i n Vocati onal 
Assessment for the Handicapped" 
Paper presented to the National 
Leadership Training I ns ti tute 
on Vocational Assessment, Seattle, 
WA. 

Vocational Eval uation and Work Adjustment 
Association. (1975). "Vocational 
Evaluation Project Final Report" 
VEWAA Bulletin , Special Edition. 

Author 

Colleen Fox Esser 

Senior Training Specialist 

Research and Training Center 

Stout Vocational Rehabilitation Institute 

University of Wisconsin-Stout 

Menomonie, Wisconsin 54751 



276 



283 



THE CAREER ASSESSMENT PROCESS IN THE 
INTERMEDIATE DISTRICT; A SERVICE TO 
A DIVERSIFIED AGE AND ABILITY LEVEL 
CLIENTELE 
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ABSTRACT: This paper describes the 
imp! ementation of comprehensive career 
services in Minnesota Intermediate 
District #287. These service ^ovide 
a wide range of specialized Services 
to a diverse audience. 

With the development of the Joint 
Intermediate District in 1967, the 
intermediate district concept became 
a reality in that it was an extension 
of service to the local community, 
local schools, business and industry 
and the Twin Cities of Minneapolis 
and St. Paul community at large. 

The Career Assessment Service 
was developed and has grown in direct 
response to the growing and continually 
changing demands of that community 
and the state. It is a career assessment 
approach incorporating many of the 
concepts of the intermediate district. 
The magnitude, the mission and the 
multitude of services provided as 
a district affords unl imited opportunities 
for a dynamic model of Career Assessment 
Services. Discussion of the Specific 
.components of the intermediate and 
the uniqueness of the services delivery 
options of career assessment are dis- 
cussed. The Career Assessment service 
(C.A.S.) demonstrates innovative 1 inkages, 
in-kind contri Dutions and a cascade 
of services career assessment ard 
planning nude 1 * unique ir; its scope 
and networking capabilities. 



Career planning and assessment 
prof ess i onal s frequently experience 
resistance and/or frustration in 
attempting to develop and implement 
new programs or to improve existi ng 
programs and services . (Sankovsky , 
1969) . Unfortunately, individuals 
from the various professional disciplines 
who are i nvol ved i n career servi ces 
often have little opportunity for 
the devel opment of interdisci pi i nary 
goal s and service 1 i nkage to provide 
a comprehensive career service model. 

Within the State of Mi nnesota 
many publ ic pol icies have been instituted 
to f c\ci 1 i tate educat i onal program 
development „ Minnesota has a compre- 
hensive plan for vocational -technical 
education which incl udes Secondary, 
Post Secondary and Adult Vocational 
Education (1963, 1976). Extensive 
planning and coo rdi nati on (HECC , 
1984 High Education Coordinating 
Commission of State educational facilities 
has been undertaken in the continuing 
effort to adequately address the 
o ecu pa ti onal preparation needs of 
Minnesota citizens. 

Hennepin Technical Centers (H.T.C.), 
Intermediate District #287 is a unique 
service del ivery unit which is comprised 
of 13 member school districts. It 
was legislatively created and sanctioned 
in 1965, when in November of that 
year Independent School Districts 
No. 271 (Bloomington), No. 273 (Edina), 
No. 274 (Hopkins), No. 280 (Richf iel d) , 
and No. 283 (St. Louis Park), suburban 
Hennepin County districts in Minnesota, 
entered into an agreement to fonr; 
the Suburban School s Services Joint 
BoarcH under Ml nnesota Statutes, 
Section 471 .59 whi ch provides for 
the Joint Exercise of Powers (1965). 
In January 1967 , Independent School 
District No. 281 (Robbi nsdal e) became 
a sixth member of the Joint Board. 
The primary function of the Joint 
Board was to serve as a cooperative 
i nterdi stri ct agency for pi anning 
Federal programs. 

The need for vocational education 
facilities in suburban Hennepin Courfiy 
became a concern of the Joint Boaru. 
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This concern was brought before the 
1967 Session of the Minnesota Legislature. 
Special Legislation, Minnesota Statutes, 
Chapter 822, was passed enabling 15 
of the Independent School • Districts 
in suburban Hennepin County to enter 
into an agreement which would establish 
a cooperative organizational structure 
for vocational education (1967). 

In the Fall of 1967, nine other 
independent school districts of suburban 
Hennepin County joined with the members 
of the Suburban Schools Services Joint 
Board to form a temporary Joint Planning 
Board for Vocational-Technical Education. 
The additional nine districts included 
Independent School Districts No. 272 
(Eden Prairie), No. 275 (Golden Valley), 
No. 276 (Minnetonka), No. 277 (Mound), 
No. 278 (Orono), No. 279 (Osseo), 
No. 282 (St. Anthony Village, No. 284 
(Wayzata), and No. 286 (Brooklyn Center ) . 

On October 10, 1968, the participating 
member districts he! d their organizational 
meeting. Formal bylaws were adopted 
in December, 1968, and were revised 
to enlarge the size of the Executive 
Committee in July, 1971. Bylaws provided 
for the appointment of two representatives 
from each parti ci pating district appointed 
by the local district board. The 
full Board of 26 was empowered through 
a Nominating Committee to elect an 
Executive Committee of 13 members. 

The need for coordination and 
development of certain special education 
activities and driver education in 
suburban Hennepin County became a 
concern of the Joint Board during 
the Fall of 1968. This concern was 
brought before the 1969 Session of 
the Minnesota Legislature. An additional 
piece of special legislation, Chapter 
945 under Minnesota Statutes, Section 
471.59 was passed in June, 1969, which 
amended the 1967 law to enable member 
districts to participate in special 
education and driver education activities 
(1969). 

The mission of this Intermediate 
district was to provide vocational- 
technical education to Secondary, 
Post-Secondary, and Adult students 
as well as Special Education Services 



to low-incidence handicapped students. 
The organization of Intermediate 
District #287 and a complex network 
of Social Services in which the District 
operates, enables it to be an optimal 
host for a wide diversity of collaborative 
efforts. 

The Districts covers over 500 
square miles in suburban Hennepin 
County with a population of 600,000 
people. It serves students referred 
from throughout the Midwest and its 
location (just west of the Twin Cities 
of Minneapol is-St. Paul Metropolitan 
area ) affords uni que opportunities 
for 1 inkages with business and industry. 
(Carter, 1984). 

The District 1 s 1983-84 revenue 
of $35,730,423 came from: 

1. Local property tax levies. 

2. Other local and county revenues . 

3. State sources. 

4. Federal sources. 

5. Sales and conversions of 
assets. 

Its 1983 schedule of assessed 
valuation (20% of market value was 
$4,654,833,048. (Carter). 

In a most cost effective manner 
Intermediate District #287 provided 
in Fiscal Year 1983-84 services within 
the following divisions. 

1. Special Education - 1,297 
students, 43,070 hours of 
instruct ion/ services . 

2. C.E.C. (Continuing Education 
Centers) providing education 
health and welfare needs 
for pregnant teenagers. 
Served 78 students, 1983-84. 

3. Secondary Vocational Programs 
which compliment and supplement 
member districts. 1,5 84 
students from the 11th and 
12th grade (10th an waiver) 
from 13 member districts 
were served during 1983-84 
at three sits in 30 programs. 

4. Post-Secondary vocational 
programs provide 64 career 
choices with full or part-time 
training serving 5,620 students 
(1983-84) at four sites. 
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5. 47,639 adults were provided 
educational services. 

6. Job Training Partnership Act 
(JTPA) served 1,446 individuals 
during the 1983-84 year. 

7. 70,001 is a nationully organi zed 
program for high school dropouts 
between the ages of 16 and 
21 who live in suburban Hennepin 
County. 235 individual s were 
served during the 1983-84 
year. 

8. Career Assessment Services 
(C.A.S.) - 522 students/clients 
were served during the 1983-84 
year. 

Given the scope and diversity 
of services offered in the Intermediate 
District, (the population base, the 
funding resources and divisions), 
the comprehensive career assessment 
services were to become a reality. 
The need for career assessment services 
within this unique intermediate district 
concept had been expressed from a 
number of areas both within and outside 
the Intermediate service area boundaries. 

During the late Seventies member 
school districts, due to decreased 
pupil service budgets and increased 
work loads, were unable to provide 
career education and assessment services 
at the needed level. Many services 
were provided by contracting with 
outside vendors. As described above, 
within the joint Independent District 
#287 were a range of service options 
which, if pulled together, could meet 
the varying and changing needs of 
the service audience. In addition, 
the Intermediate District recognized 
the specialized needs of the large 
number of handicapped citizens living 
in suburban Hennepin County and implemented 
support options according to the Rules 
and Regulations of 92-142 (DRF, TITLE 
45> PART 121.3a) especially in response 
to the wording . . . 

"to assure that every handicapped 
child who leaves school has had 
career educational training that 
is rel evant to the job market . . ." 



Based on this need the JISD 
#287 Board approved the development 
of .* career assessment service model, 
fcc 1 ! t impl emented on a pi 1 ot basis 
I the 1981-82 school year. 
1981 - Vocational Assessment 
Pr^, ' presented to the Board). 
The osal was the result of an 
ir« .tudy which had been previously 

co ( and as a response to numerous 

request., for vocational assessment, 
within the Intermediate district. 
At thir point a coordinator was assigned 
and individual staff members from 
all divisions were appointed to complete 
a nee> ; assessment and to outline 
the sc^pe of services required within 
the District. This group established 
cri teri a which was deemed essential 
to the success of a career assessment 
service. These components included: 

1. Strong support from JISD 
#287 Board and the local 
administration for the program. 

2. A linkage and in-kind sharing 
between all Intermediate 
District Divisions (Secondary, 
Post-Secondary, Adult, Special 
Education, JTPA). 

3. Positive attitude and support 
from all Intermediate District 
staff toward the needs of 
all individual students/clients. 

4. Strong, comprehensive student 
support services. 

5. Commitment to the philosophy 
emphasizing supportive education 
servi ces to students needi ng 
specialized instructional 
assistance to succeed in 
trai ni ng . (Exam pi es of this 
would include providing inter- 
preters in the classroom 
for the hearing impaired, 
mobil ity aides in assisting 
the physically impaired, 
physical therapists, etc.) 

6. Direct access to al 1 existing 
resources available throughout 
the District. 

7. That the service will not 
function as a funnel arid 
screen for HTC programs but 
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will meet individual career 
needs . 

With this criteria in mind, a 
review of the literature and contacts 
with existing facilities were completed 
to determine the level and kind of 
services which existed within the 
community. Upon completing this review, 
it was determine that the Intermediate 
District #287 Career Assessment Service 
model must include the assessment 
of interest, aptitudes, work skills, 
work tolerances and work habits through 
the use of work, real or simulated, 
as the focal point of the assessment. 
(May, 1972). Additionally, it was 
felt that the goal of an assessment 
service should be to assist the stu- 
dent/client to become more productive 
until he or she is able to adequately 
function in an "achievement-demanding" 
setting. (Gellman, Stern and Soloff, 
1963). With these theories functioning 
as a cornerstone, the Career Assessment 
service staff began the work of imple- 
menting services within the District. 
The traditional vocational evaluation 
models (Pruitt, 1977), and (Tenth 
Institute, 1972) were utilized as 
a guide in establishing services. 
This model included: 

1. Referral (to include case 
history consultation). 

2. Intake and Initial Interview 
to determine the appropriateness 
of referral and level cf service 
required. 

3. Vocational Evaluation which 
included psychometric, and 
work sample testing, behavioral 
observations , review of work/educa- 
tional history and other special- 
ized testing. 

4. Occupational try-out, being 
an actual "hands-on" lab experi- 
ence, within a determined 
trai ni ng program or work experience 
site - (the primary objective 
of the try-out being to provide 
the client with further exposure 
to a specific program as well 
as obtaining additional information 
as the the cl ients' skills, 
abilities and behaviors, related 



to the s pec.i f i c trai ni ng 
area ) . 

5. Staffing/Report - career 
assessment results are conveyed 
to the referral source through 
a combined means of a staffing 
and the comprehensive final 
written report. 

A coordinator was assigned from 
the Vocational Division to develop, 
organize and guide the pilot program, 
under the direction of the Intermediate 
District's division directors and 
local school district administrators. 
It was this steering committee that 
devel oped a budget wi th ref 1 ected 
the service audience needs that first 
year (secondary aged handicapped) 
and reimbursement was at 65% from 
State Secondary Special Needs dollars. 
A demonstration grant was written 
to gain additional revenue to hire 
a vocational evali-ator and a secretary. 

Also, in-kind contri but ions 
of staff and other resources were 
given by many of the Intermediate 
Divisions. After much research, 
material development, and lab set-up, 
the first student was accepted for 
service and began the career assessment 
process in January of 1982. From 
January through June of 1982, 72 
secondary aged handicapped students 
were provided a comprehensive career 
assessment experience. During 1982-83 
additional resources and staff were 
mobilized as the joint board authorized 
the pi 1 ot project to conti nue under 
fully approved program status. Three- 
hundred f i fty cl ients were served 
during 1982-83. As the new program 
grew in size so too did the scope 
of audiences served. 

During the 1983-84 school year 
over 500 persons rangi ng in age from 
14 to 66 experienced career assessment. 
In addition, "Career screening 1 ' was 
provided to 152 individuals, on an 
outreach basis. Career Screening 
is a short term, informational gathering 
process to assist an individual in 
developing a career path. To accompl ish 
this variety of psychometric tests 



293 



are administered including, but not 
limited to the following: (1) Interest 
Testing, (2) Achievement Testing, 
(3) Aptitude Testing and (4) Work 
Value Testing. Identification of 
career interest areas, aptitudes and 
work temperaments, aids in career 
counseling and provider an individual 
with a focal point for career exploration. 
The referral base had also been opened 
up to include all levels of students 
and clientele within and outside the 
district, including private for profit 
rehabil i tat ion agencies . A comprehensive 
fee schedule was developed during 

1983- 84 to entertain any type of referral , 
and those dollars were credited to 
an assessment service enterprise account. 

One recent i nnovati ve expansion 
was the Career Life Planning option 
which was provided to laid-off teacners 
from local school districts. Tnese 
teachers were offered vocational testing 
and assistance in developing a career 
plan. This ras accomplished through 
a combined effort of several divisions 
within the Intermediate District (Career 
Assessment Service , Post-Secondary, 
HTC-JTPA and the Administrative offices) . 

This option was initiated and 
developed in a joint fashion by local 
district union officials, personnel 
specialists and the Career Assessment 
Service staff. 

The current C.A.S. service delivery 
system has evaluation labs at two 
vocational technical sites and uses 
many other district and member district 
facilities in outreach. The core 
evaluation labs on the two campuses 
occupy approximately 7,000 square 
feet of space and provide a diversity 
of ca reer assessment tool s both com- 
mercially and locally developed (MESA, 
SINGER, Project Discovery, Job Search, 
Choice, Vocationology, etc.). The 

1984- 85 Operational Budget is approximately 
$400,000. The program is staffed 
by a Coordinator/Psychologist, five 
M.S. level vocational eval uators , 
four 1 i censed vocati onal oval Liation 
technicians, numerous in- kind specialists 
(Technical tutors , interpreters , OT's 
PT's, LEP, etc.) and secretarial staff. 



Additional staff positions and consu- 
1 tati ve dol 1 ars have been budgeted 
for continued expansion of service. 
Plans have been developed with Division 
of Vocational Rehabilitation and 
private placement specialists to 
provide on-going in-service to the 
C.A.S. staff regarding labor market 
analysis and trends . At this poi nt , 
the Career Assessment Service has 
grown in a positive, controlled direc- 
tion. The uniqueness and variety 
of services offered within the Inter- 
mediate District has been described 
as a host for development and fostering 
of an innovative career assessment 
model . 
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OHIO SCHOOL BASED WORK EVALUATOR TEACHER 
CERTIFICATION PROGRAM 



ERV NAPIER 



ABSTRACT: In Ohio, a program has been 
designed to facilitate access to public 
school vocational education as a viable 
placement for special students through 
which meaningful and appropriate pre- 
paration for the world of work can 
be found. This program is the Vocational 
Work Evaluation Teacher Education 
program. The purpose of this program 
is to provide needed and relative 
information to aid school personnel, 
parents, and students in making informed 
occupational choices for special students. 



School based work evaluation 
is seen as appropriate and relevant 
for service to school aged handicapped 
and disadvantaged students as their 
needs rel ate to vocational education. 
Traditional evaluation programs are 
concerned by individual s or agencies 
not fully knowledgeable of the locally 
available vocational education programs. 
These traditional prograns may not 
always be available to serve the 
large numbers of special students 
for w L vocational education is 
a definite resource. 

There is a need, then to provide 
work evaluation that is localized 
to the prevailing conditions within 
vocational education programs; localized 
such that school aged hand i capped 
and di sadvantaged students may have 
access to the vocat i onal education 
programs appropriate to their needs, 
interests, and abilities. Only evaluators 
who are thoroughly knowl edgeabl.e 
of the evaluation process, the nature 
and needs of special student populations, 
and 1 ocal vocational program indio- 
syncrasies can access these programs. 
The Ohio model for vocational work 
eval uati on teacher educati on makes 
i t possi bl e for work eva uators at 
the local school 1 evel to function 
effectively, insuring this needed 
access. 

Persons entering the program 
must have a bachelor's degree in 
one of five areas - psychology, special 
education, counseling, rehabilitation, 
or evaluation. Each degree experience 
provides di fferent strengths relative 
to testing and measurement, education, 
special popul at ions , or eval uati on. 
The program capitalizes on these 
strengths and supplements any short- 
comings. 

All employed evaluators are 
required to have expertise with the 
work sampl e equi pment used in the 
eval uati on process . Thi s experti se 
may be obtained by pre-service training 
with equipment manufacturer's coursework 
at a college or university, or through 
onsite in- services provided by qualified 
work evaluators. The new evaluator 
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must have twel ve months of work experience 
not connected with education. All 
the above prerequisites must be verified 
by the Special Needs i/rvice, Division 
of Vocational Education, Ohio Department 
of Education. Instruction that provides 
a thorough working knowledge of local 
vocational programing is provided 
to the new evaluator regardless of 
thefr backgrounds. 

Qual i f i ed new eval uations are 
employed by a local school district 
and given temporary one-year vocational 
education certificates renewable upon 
successful completion of one year 
of the teacher education program. 
This certificate provides the educational 
legitimacy necessary in public school 
systems. With successful completion 
of a second year of the program the 
evaluator may apply for an advanced 
certificate as a Vocational Work Evaluator. 

The certification program is 
structured in three phases. The first 
is pre-service phase followed by two 
years of in-service. The pre-service 
phase purposes are: 

1. to give the newly employed 
evaluator an over-all view 
of the work evaluation process 
and it's role in vocational 
education. 

2. to acquaint the newly employed 
evaluator with vocational 
education and the Vocational 
Education Special Needs Service. 

3. to acquaint the newly employed 
evaluator with handicapped 
and/or disadvantaged students. 

The pre-service phase is conducted 
as a one-week seminar in which various 
specialists make presentations relative 
to evaluation in the school setting. 
State department officials, university 
faculty, and practicing school eval ua tors 
comprise the group of specialists. 

The first in-service year concentrates 
on developing and improving the quality 
of localized evaluational activities 
to meet local needs. To meet this 
goal the evaluator completes fourteen 
objectives designed to establish or 
verify the existence of certain program 



qual ity measures. (These goals are 
included at the end of this paper). 
The focus of these goals is the efficient 
and effective operation of the eval uation 
program. Consideration is given 
to the development and use of. advisory 
committees , the capacity of the evaluation 
program to assess the characteristics 
and abilities necessary for entry 
into and predicted success in local 
vocational programs , compl iance with 
State and Federal guidelines, quality 
of evaluations, and the understanding 
of professional vocational and vo- 
cationally rel a ted organizations 
and associations. Activities are 
conducted on site by the Special 
Needs Teacher Educator from Kent 
State Uni vers i ty . Approximately 
ei ght vi sitati ons are conducted in 
the first year of the program. 

J\ e second i n- service year and 
third phase of the teacher education 
program, the evaluator provides the 
documentation of pi anned functions 
and operations of the evaluation 
center in the same manner that a 
curriculum documents classroom instruc- 
tion. The evaluator develops a fom.al 
document similar in purpose to a 
course of study. Significant parts 
of this document are: 

1. introductory statement 

2. program and school philosophies 

3. program objectives 

4. program overview 

5. evaluation practices 

6. evaluation activities 

7. glossary of specific terms 

During, the second year the 
evaluator is also concerned with 
the content of a course titled "Survey 
of Vocational Education." This course 
deal s wi th the history, phil osophy , 
and operation of vocational education 
at the national state levels. The 
course is in tended to develop and 
refine the eval ua tor's knowledge 
and understanding of vocational edu- 
cation. A required term paper documents 
the evaluator's comprehension of 
the intricacies of vocational education. 
Second year activities are conducted 
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by monthly visits from the Special 
Needs Teacher Educator from Kent State 
University. 

A large amount of work is obviously 
required of the evaluator during this 
pre and in-service program. The Ohio 
Department of Education, therefore, 
requires the participating evaluator 
in the professional improvement program 
to enroll for nine semester hours 
of undergraduate or graduate credit 
at Kent State University, the cooperating 
delivery agency for the program. 

Spec i al resources are frequently 
necessary if special students are 
to be successful in schooling experience. 
For many special students, vocational 
education is not only a viable alternative 
to the regular classroom but extremely 
important to providing the preparation 
necessary for life after school in 
the world of work. Before vocational 
education can fulfill any of its promises 
or obligations to special students, 
competent and know! edgeable work evaluators 
must be available to provide the necessary 
data for relevant for appropriate 
vocational choices. In this sense 
work evaluators working in the local 
school setting serve as very special 
resources to special students in Ohio 
- a resource made functional by the 
school based certification program 
for work evaluators. 

OBJECTIVES 
1st - YEAR WORK EVALUATION TEACHER 
EDUCATION 

1. Develop, refine, and promote 
the Work Evaluation program through 
the use of an Advisory Committee. 

2. Assess the capacity of the Work 
Evaluation program to recommend 
placements in all vocational 
education programs within the 
school system. 

3. If, after objective #2 is completed, 
a need is indicated, develop 
work samples as necessary to 
enable assessments appropriate 
to vocational education programs 
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within the school system. 

4. If, after objective #2 is completed, 
a need is i ndi cated , devel op 
purchase recommendations as 
necessary to enabl e assessments 
appropriate to vocational education 
programs within the school system. 

5. If, after objective #2 is completed, 
a need is i ndi cated , devel op 
situational assessments as necessary 
to permit vocational class tryouts 
for Special Needs students. 

6. Assess the capacity of the work 
eval uation program to adequately 
serve Special Needs students 
by: 

a. determining an documenting 
the degree to which students 
have been successful in recom- 
mended placements. 

b. determining the degree to 
which vocational and special 
education and gui dance and 
counseling staff members 
agree that the Work Evaluation 
program is adequately equipped 
and staffed to serve Special 
Needs students. 

c. determining the degree to 
which vocational education 
teachers agree that Special 
Needs students are adequately 
served by the Work Evaluation 
program. 

7. Ascertain that the work evaluation 
program provi des adequate data 
and in an appropr i ate format 
for use in serving Special Needs 
students at staffings and in 
necommended placements. 

8. Develop a document descri bi ng 
the rol es of Work Eval uation 
in reference to the rol es of 
vocational education. 

9. Develop and implement an in-service 
program to inform the elementary 
and secondary, special education, 
and vocational education faculties 
of the roles of the Work Evaluation 
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program in the education process 
for Special Needs students. 

10. Develop and implement a program 
to better inform the general 
public about the purposes and 
operation of the Work Evaluation 
program. 

11. Devel op a 1 ist of availabi t ommunity 
resources that can provide appropriate 
services for Special Needs students 
beyond those provided by vocational 
education within the local school 
system. 

12. Develop and maintain a work Evaluation 
program record keeping system 
sufficient to: 

a. meet Vocational Special Needs 
Service supervision guidelines. 

b. permit assistance to vocational 
teachers , guidance and counseling 
personnel , special education 
personnel , and school system 
administrators. 

c. enable program follow-up studies. 

d. permit periodic reports of 
Work Evaluation program activi- 
ties . 

13. Prepare and disseminate periodic 
reports of Work Evaluation program 
activities to all interested 
school personnel . 

14. Demonstrate an understanding 
of professional education associ- 
ations involved with vocational 
education and vocational special 
needs. 
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A COMPREHENSIVE EMPLOYABILITY ASSESSMENT 
STRATEGY FOR DISABLED PERSONS 



RICHARD ROESSLER 
BRIAN BOLTON 
SUKI HINMAN 



ABSTRACT: Empl oya bi 1 i ty refers to 
the personal attributes or functional 
vocational capabilities (FVC f s) that 
the individual possesses. Related 
to performance in the work place, 
these FVC's can be enhanced through 
the proper types of rehabilitation 
services* However, it is difficult 
to select these services unless a 
comprehensive employabil ity assessment 
of the individual has been conducted. 
This paper discusses the elements 
and emphases of such an assessment 
in terms of a Diagnostic Employabil ity 
Profile (DEP) currently being developed 
at the Arkansas Research and Training 
Center on Vocational Rehabilitation. 



A recent VEWAA monograph (Roessler 
& Bolton, 1983) addressed the distinction 
between empl oyment and empl oyabil ity. 
Empl oyment represents the outcome 
or end goal or rehabilitation services. 
The probabil ity of achieving a successful 
outcome with an individual is largely 
the function of four classes of vari- 
ables: (a) work-related aptitudes, 
skills, values, and attitudes of 
the person, (b) quality of rehabilitation 
services, (c) level of support from 
si gni f icant others , and (d ) 1 abor 
market conditions. 

The Diagnostic Empl oyabi 1 ity 
Profile addresses two categories 
of variables : 

1. Stable characteristics such 
as abilities, interests, 
and personality traits that 
are important considerations 
in job/person matching. 

2. Modifiable skills germane 
to employabil ity, i .e. , the 
critical behaviors needed 
to seek and maintain work. 

Assessment of the individual's status 
on these two classes of variables 
resul ts in an employabil ity profile 
which has implications for program 
planning, vocational counseling, 
and work adjustment training. 

Our model for empl oya bil ity 
assessment is derived from three 
existi ng theories that evol ved from 
research and services in vocational 
rehabil itation: (a) the Minnesota 
Theory of Work Adjustment (MTWA) 
provides an excellent psychometric 
framework, (b) the Chicago JVS theory 
of work adjustment is based on clinical 
insights into individual functioning, 
and (c) Hershenson's model provides 
a necessary developmental perspective. 

Assessment and intervention 
strategies discussed in this paper 
are especially appropriate for severely 
disabled individuals who are receiving 
services from rehabilitation facilities 
and workshops , These i ndi vidua 1 s 
should have completed most medical 
eval uati on and restoration services 
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so that they have reached a reasonably 
stable level of physical functioning. 
They woul d then be ready for comprehensive 
employabil i ty assessment and intervention 
in order to prepare them for successful 
employment. Use of these assessment 
techniques is not, however, limited 
to facilities; they are equally appro- 
priate for efficient diagnostic work 
in field settings. Such developmental 
research is planned as part of our 
Center's five year research plan. 

Propositions 

Comprehensive empl oyabil ity assessment 
deals with those functional vocational 
capabilities (FVC's) related to success 
in selecting, obtaining, and maintaining 
jobs. It presumes adequate collection 
and accurate interpretation of social 
history and medical data. Other pro- 
positions equally essential to our 
employabil ity assessment program are: 

1. Disabled persons are underrepre- 
sented in the work force. 

2. Persons seeking services from 
the pu bl i c VR program need 
multiple employabil ity services 
if they are to secure more 
than temporary, secondary 
1 abor market jobs. 

3. Vocational success is a function 
of the match of person (abil ities 
and values) to job (demands 
and reinforcers) . 

4. Employment must be viewed 
as developmental, i.e., as 
1 eading to a career , rather 
than as static, i.e., as completed 
once an entry level job is 
secured. 

5. Career encompasses four stages— 
exploration, establ ishment , 
ma i nte nance , and reti rement ; 
the first three stages are 
particularly important in 
vocational rehabil i tat ion. 

6. To fulfill the task demands 
of exploration, establ ishment, 
and maintenance, rehabilitation 
clients must (a) understand 
how their abilities, aptitudes, 
interests, and personal ity 



predi s positions affect their 
vocational functioning and 
(b) develop the specific 
skills essential for job 
selection, acquisition, a nd 
maintenance. 

7. Empl oyabi 1 i ty assessment, 
therefore, must encompass 
stabl e characteri sti cs such 
as intel 1 igence , aptitudes, 
and interests, and modifiable 
characteristics such as job 
seeking and maintaining skills. 

8. Enhancing vocational success 
involves multiple services, 
e.g. , (a) diagnosis of functional 
vocational capabilities, 
(b ) i nterventions to enhance 
sel funderstanding and skill 
1 evel s , and (c) environmental 
modi fi cat i ons through job 
anal ysi s , modi f icati on , and 
restructuring. 

9. An employabil ity counseling 
model should be developed 
for individuals with disabilities 
that meets the following 
criteria: (a) the role of 
the client as co-manager 
should be respected and (b) 
the basic counsel ing orientation 
shoul d be faci 1 i tati ve and 
nondeterministic. 

10. Implementation of the model 
re qui res both a Diagnostic 
Empl oyabi 1 i ty Profile and 
Employabil ity-enhancing Inter- 
ventions . 

Diagnostic Employability Profile 
(DEP) 

To identify dimensions to include 
in a Diagnostic Employability Profile, 
we reviewed 15 measures frequently 
used in vocational evaluation settings. 
In a figure enti tl ed "Functional 
vocational ca pa bil ities compri sing 
general employability" (Roessler 
& Bolton, 1983, p. 7), we presented 
the results of this review. Section 
II in that figure (Roessler & Bolton, 
1983, p. 7) can further be elaborated 
to specify variables comprising the 
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work personality as defined by Walter 
Neff. Variables in Section II are 
directly related to the manner in 
which individuals cope with the demands 
of work. Lacking these fundamental 
skills, some individual receiving 
vocat i onal rehabil i tat ion services 
are unable to find and maintain a 
job so that the other elements of 
the match principle can operate, i.e., 
the balance between higher order worker 
needs and work reinforcers , and between 
worker competencies and work demands. 

The purpose of em pi oyabi 1 i ty 
assessment , therefore , is to i denti fy 
not only the skill deficits related 
to selecting, finding, and maintaining 
a job but also the abilities and prefer- 
ences relevant to matching person 
and job optimally. This task includes 
the following considerations: (a) 
constructs to measure, (b) assessment 
instruments to select, (c) types of 
interventions to develop, and (d) 
outcomes desired from the interven- 
tions. Figure 1 presents one perspective 
on these concerns as they relate to 
the Diagnostic Empl oyabi 1 ity Profile. 
Each col umn addresses two broad categories, 
stable characteristics and modifiable 
skil 1 s . 

Stable Characteristics 

In addition to intelligence and 
achievement measures, instruments 
assessing sel ected stabl e characteristics 
include the GATB/NATB, USES Interest 
Inventory, and the 16 PF-E. The GATB 
and NATB, are reading and nonreading 
versions of a well-known aptitude 
battery developed by the U.S. Employment 
Services . Nine speci fic aptitudes 
are measured ranging from estimates 
of general intel 1 i gence to manual 
dexterity. GATB/NATB results relate 
to a series of Occupational Aptitude 
Patterns (OAP's) that suggest a wide 
variety of vocational alternatives 
for which the person possesses the 
requisite aptitudes. 

GATB results can be combined 
with data from another measure, the 
USES Interest Inventory, to determine 



which of the OAP's are consistent 
with the persons vocational interests. 
Cross referencing aptitudes and vocational 
interests enables the evaluator to 
devel op an even more precise list 
of job possibilities. Although a 
significant step, interrelating aptitudes 
and interests does not provide all 
of the vocational counsel ing information 
needed regarding stable empl oyabi 1 ity 
characteristics. A measure of personality- 
related predispositions and preference 
is, therefore, included in the DEP. 

The 16PF-E is a standard measure 
of normal personal ity function assessing 
primary and secondary personality 
factors Results are useful in vocational 
counsel ing because they indicate 
(a) problems that might inhibit the 
person's performance such as high 
social anxiety or low self-esteem 
and (b) personal preferences or styles 
that would interact significantly 
with different types of job demands. 
Greater self-awareness of these perfor- 
mance i nhi bitors and personal styl e 
preferences would enable the individual 
to make mo^e realistic job choices. 

Modifiable Skills 

In the area of modifiable skills, 
the f irr t construct of interest i s 
employab il ity maturity. The work 
of Donald Super and John Crites provides 
many i nsi ghts regardi ng the nature 
of empl oyabil ity maturity. As we 
use it, this concept includes three 
components: (a) knowledge of self, 
the world of work, and preferred 
occupational roles and careers, (b) 
real i sm in occupational preferences , 
decisions , and choices , and (c) problem— 
solving and deci si on-making skil 1 s . 
To minimize the effects of literacy, 
empl oyabi 1 ity maturi ty i s assessed 
via a structured interview. Specific 
questions deal with the knowledge, 
realism, and problem-solving attributes 
of the person as they relate to the 
tasks involved in selection and acquisi- 
tion of work. Results of the interview 
are intervention oriented , i.e., 
f i ndi ngs from the i nterview i ndi cate 
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counseling or training that the person 
needs to improve his/her job readiness. 

To assess another important area 
of modifiable skills, the simulated 
job interview samples an individual's 
behaviors in terms of starting the 
i nter vi ew; ex pi ai ni ng ex peri ences , 
skills, and work history; discussing 
disabil ity , ■ sal ary, fringe benefits , 
and advancement; and closing the inter- 
view, a detailed behavioral checklist 
has been developed to score the indivi- 
dual 1 s performance and , more importantl y , 
to identify deficits for interview 
training. 

A composi te job appl ication has 
also been developed for the individual 
to complete. Performance on the job 
application is evaluated in terms 
of neatness , correct grammar and spelling, 
completeness, and total time required 
to complete the form. Application 
and job interviewing skill s are important 
for obtaining a job; maintaining employ- 
ments , however, another important 
area to evaluate. 

Two approaches to the evaluation 
of job maintenance behavior are included 
in the DEP; a series of simulated 
work situations (Work Performance 
Assessment/WPA) and a behavioral rating 
scale requiring observation of actual 
work performance (Work Personality 
Profile/ WPP) . By administering the 
WPA, the vocational evaluator can 
determine how individuals typically 
respond to the interpersonal and task — 
related demands of work. Gathered 
through simulated situations dealing 
with task performance, teamwork, social- 
izing on the job, and dealing with 
supervisors, results provide a profile 
of the individual's employment potential 
in terms of specific behavioral strengths 
and weaknesses. This profile can 
be used in identifying significant 
job/person match considerations and/or 
in developing behavioral work adjustment 
interventions . 

Based on the early work of William 
Gel 1 man , the work Personal ity Prof i 1 e 
(WPP) is a comprehensive observer-rating 
instrument designed for use in vocational 
adjustment settings. The WPP enables 



rehabilitation professionals to identify 
deficits in 58 specific work behaviors 
that are organized into the following 
eleven categories of work performance: 
acceptance of work role, ability 
to profit from instruction or correction, 
work persistence , work tol era nee , 
amount of supervision required, extent 
trainee seeks assistance from supervisor, 
degree of comfort or anxiety with 
supervisor, appropriateness of personal 
relations with supervisors, teamwork, 
ability to socialize with co-workers, 
and social communication skills. 
WPP data can serve as a basis for 
(a) the devel opment and assignment 
of clients to remedial programming , 
and (b) the measurement of improvement 
in targeted work behaviors by completing 
the WPP at regular intervals. 

Reporting DEP Results 

Results from the i ns t rumen ts 
listed in Figure 1 and from a thorough 
analysis of social history and medical 
data (Roessler & Rubin, 1980) combine 
to form a profile of the individual's 
employabil ity strengths and deficits. 
Reporting these findings in a meaningful 
way is, however, no simple undertaking. 
In this section, we discuss tentative 
guidelines for reporting the Diagnostic 
Employability Profile (DEP). 

The prof ess ional responsibil ity 
for interpreting the DEP lies with 
vocat ional evaluators; they have 
the expertise to identify a wide 
range of potentially feasible vocational 
objectives for the client. To the 
degree possi bl e , these vocational 
recommendations should be made in 
terms of a career rather than a single 
entry level position, i.e., potential 
vocational goals should be presented 
in a hierarchical fashion representing 
a typical career pattern in a given 
industry. The client's, counselor's, 
and f ami 1 y members ' reactions to 
these possi bl e vocational rol es are , 
however , cri ti cal to understanding 
the suitability of each recommendation. 

In relation to stable client 
characteri sti cs , important job/person 
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match issues should be discussed, 
i.e., work demands or psychological 
climate aspects of different jobs 
that would or would not be consistent 
with client preferences. Data for 
these conclusions can be drawn from 
occupational i nformati on resources 
regarding specific jobs and from results 
generated by such DEP elements as 
the USES Interest Inventory, the GATB/NATB, 
and the 16 PF-E. 

Empl oyability strengths and weaknesses 
should be behavioral ly described based 
on results from the Work Personality 
Profile, the Work Performance assessment, 
and the simulated job application 
and interview. These assets Or limita- 
tions should be related to a specific 
job seeking or mai ntai ni ng demand 
such as those identified in a recent 
literature review (Roessler, 1983). 
Empl oyabil ity interventions should 
then be specified for critical employ- 
ability skill deficits. 

Empl oyabil ity Interventions 

Interventions suitable for modifying 
functional vocational capabil ities 
can be developed from resources describing 
career adjustment (Bolton & Roessler, 
1982), social skills training, and 



work adjustment. For example, in 
the area of job maintenance, we have 
previously outl ined four modules 
for development: Interpersonal/social 
demands of work-deal ing with co-workers , 
Interpersonal/social demands of work - 
responding to supervisors and employers , 
Organizational adaptabil i ty/conformity 
to work setti ng rul es , and Position 
performance (Roessler & Bolton, 1983, 
P. 17). 

Each empl oyabi 1 ity module will 
he! p trainees improve their capabil ities 
to (a) assess situations ( when should 
one use these skills?), (b) process 
or make res ponse deci sions (What 
are the various response options, 
and (c) respond appropriately ( how 
can one translate response options 
i nto behavior?) . The format for 
the modules will follow social skills 
training principles, e.g., (a) describe 
the behaviors involved and their 
importance to success on the job, 
(b) model correct application of 
the skills in an appropriate context 
or contexts, (c) rehearse the skill 
components through role-play situations 
or social interactions , (d) reinforce 
correct appl ication of skill components , 
(e) identify specific aspects of 
the performances that need to be 
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Major Components of a Diagnostic EmpJ.oyability Profile 
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changed , and (f ) encourage general ization 
of skill improvement of the natural 
environment through homework assignments. 

Conclusion 

Increased emphasis on empl oymant 
as an outcome in vocational rehabil itation 
has resulted in more attention to 
the concept of empl oyabil i ty. Defined 
in terms of stab! e and modif iabl e 
characteristics, empl oyabil i ty can 
be diagnosed through a combi nation 
of of traditional psychometric and 
behavioral assessment techni ques . 
Results of these strategies* combine 
to form a Diagnostic Empl oyabil ity 
Profile indicating important job/person 
match and skill training considerations. 
Proper use of this DEP contributes 
to the enhancement of client employ- 
ability, and thus to the employment 
success of individual s receiving rehabili- 
tation services. 
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VOCATIONAL ASSESSMENT OF LEARNING 
DISABILITIES 
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ABSTRACT: In light of the fact that 
the incidence of learning disability 
has been estimated as representing 
up to 25% of the school population 
(Hurst, 1968), it is not surprising 
that in recent years there has been 
increasing recognition that there 
are many individual s who having previously 
experienced academic difficulty are 
now, as adults, experiencing vocational 
difficulty. This papers examines 
one reason why this problem has not 
received much prior recognition, the 
relatively unique diagnostic problem 
presented by a learning disability. 



Unl i ke many di sease snti ties 
which are based on specific laboratory 
and clinical findings, learning disabi- 
lities are typically defined on the 
bases of stati stical formul ae which 
determi ne cr i ter i a which must be 
general , the diagnosis of learning 
disability requires a certain measure 
of discrepancy between measured ability 
(IQ) and academic achievement (reading 
or count ing ski lis), wherein the 
discrepancy is presumably due to 
some ' ype of neurol ogi cal 1 y based 
limitation on information processing. 

Because the presumptive etiology 
of spcci f ic 1 earni ng di sabil i ty is 
of neurologic origin, and the requirements 
for eligibility depend on psychological 
assessment, a neuropsychol ogi cal ly 
focused vocational evaluation is 
the di agnostic procedure of choice . 
This will help put into perspective 
the ways in which such evaluation 
can be util ized i n optional fashion 
for sorts of data which can be expected 
from a comprehensive neuropsychological 
evaluation of vocational potential. 

Cerebral Hemispheric Specialization for 
Information Processing 

In almost all right handed and 
the majority of the left handed people, 
the left cerebral hemisphere is special- 
ized for processing information which 
is primarily verbal , logical , sequential , 
abstract , and analytic. Conversely, 
the right cerebral hemisphere specializes 
in processing. 



Cerebral Hemispheric Asymmetry 

In approximately 77% of both 
adults and children there is convincing 
evidence that the two cerebral hemispheres 
are asymmetric both in size and functional 
efficiency (Geschwind & Levi tsky , 
1968; Hartlage, 1982). This is an 
important concept for vocational 
pi anning , si nee a number of worker 
trai t character i sties i nteract wi th 
specific learning disabilities (or 
aptitudes) on the basis of functional 
cerebral hemispheric asymmetry. 
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Individuals with dysfunctional right 
hemispheres, in addition to being 
at risk for vi sua! -spatial learning 
disabilities and work related problems, 
tend to be more inclined to impulsive, 
less reflective approaches to problem 
solving, in what neurologists often 
refer to as n la belle indifference" 
life styles. An individual with right 
cerebral hemisphere dysfunction resultant 
from a stroke, for example, may commonly 
deny any impairment or problem, even 
though the sequelae have left considerable 
weakness of the left side of the body 
or even a left hemiplegia. Such indivi- 
duals often respond impulsively to 
questions, giving an impression of 
lowered abil ity level s than they possess , 
or give occasionally bizarre responses 
to personality assessment measures, 
giving an impression of impaired reality 
testing. With left hemisphere dysfunction, 
in addition to language impairments, 
i ndi vidua 1 s are 1 i kely to be much 
more uncertain and tentative, in what 
neurologists refer to as a "catastrophic 
reaction." An individual with left 
hemisphere problems following a stroke, 
for example, is likely to require 
a great deal of reassurance and encourage- 
ment, and to suffer from depression 
and feelings of helplessness. Such 
individuals are often doubtful of 
their own abilities, and reluctant 
to respond to questions about whose 
answer they aren't certain may give 
an impression of greater mental impairment 
than they actually suffer. 

In mi 1 der forms of 1 ateral ized 
cerebral asymmetry, right hemisphere 
deficient individuals are more likely 
to appear careless and uneven in their 
application of attention to a task, 
and to be compari ti vely poor in monitoring 
their own behavior. Left hemisphere 
deficient individual are often seen 
as lacking i ni ti ati ve , perhaps bei ng 
too compulsive, and having difficulty 
adjusting to changing work situations. 
The behavioral differences associated 
with cerebral hemispheric functional 
asymmetries tend to be especially 
pronounced among i ndi vi dual s who have 
had^neurol ogical ly mediated learning 



problems of a long standing duration, 
probably reflecting the individuals' 
attempts to deal with their selective 
cognitive processing weaknesses. 
The child who has always experienced 
difficulty dealing with such right 
hemisphere dependent tasks as picture 
puzzl es , f i ne eye-hand coordination 
tasks, and spatial orientation, is 
more likely to try to use language 
or other left hemisphere mediated 
abilities to sol ve problems, while 
the child with chronic language problems 
may find greater satisfaction in 
deal i ng wi th activities where doing 
rather than talking about a task 
is more likely to be met with success. 
Thus we find a number of various 
historical attempts to classify indivi- 
duals according to their approaches 
to problem solving (Gardner et. al., 
1959; Witkin et.al., 1962) which 
have stri king res em bl a nee s to the 
sorts of uneven mental strengths 
attri butabl e to functional cerebral 
hemisphere asymmetry (Hartlage, 1982). 

Learni ng di sabil i ty theori sts 
have shown fairly consistent attention 
to functional neurologic asymmetry 
in their attempts to classify learning 
di sabil i ties, as represented by Bannatynes 
"spatial" vs. "linguistic" psychological 
learning disability classification 
(Bannatyne, 1968) or Boder' s neurological 
"hyseidetic" vs. Dysphonetic classifi- 
cation of learning disabilities (Boder 
and Jarrice, 1982). 

The role of functional cerebral 
asymmetry as r el a ted to 1 earni ng 
disabil ity is especial ly important 
for i nterventi on pi anni ng , since 
there is evi dence to suggest that 
neurologically mediated behaviors 
are selectively influenced by use 
or disuse, with those functions which 
are comparatively less used tending 
to have reduced output of transmitter 
storage vesicles to adjust for the 
decreased need (Aletta and Goldberg, 
1982). Thus an individual whose 
preferred mode of information processing 
i nvol ves 1 i ngui sti c , sequential , 
analytic cognitive approaches may 
be expected to become not only less 
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efficient but in fact less functionally 
capable of information processing 
invol ving spatial , hoi istic, simultaneous 
cognitive approaches. Although this 
phenomenon has given some encouragement 
to special educators who wish to remediate 
deficit functions by encouraging their 
increased use, review of the fairly 
comprehensive literature on the topic 
supports and emphasis on focusing 
attention on stronger information 
processing systems, both as a means 
to maximize a given individual 's likelihood 
of success on a given task and as 
a means of avoiding frustration and 
discouragement by focusing on a relatively 
weak processing system (Hartlage & 
Telzrow, in press). If one recognizes 
the fact, for example, that poor perfor- 
mance on word recognition is caused 
by a dysfunction in the central visual 
process (cortical blindness), it is 
obvious that approaches toward remediation 
of the deficit are not nearly so likely 
to prove successful as are approaches 
to compensation for it, such as utilizing 
auditory or tactile processing modal- 
ities. Conversely, of course, if 
poor word recognition occurs in an 
individual with intact neurological 
mediation who has not been exposed 
to an opportunity to learn to read, 
remediation of this deficit by tutoring 
or educational enrichment represents 
a more reasonabl e strategy. Neuropsycho- 
logical assessment of learning disabil- 
ities can thus be of considerable 
value in the differentiation of which 
deficits in a given processing system 
are due to neurol ogical ly limiting 
substrates, and thus will be more 
amenable to substitute or compensatory 
intervention, and which reflect more 
environmentally limited functions 
which can be al 1 evi a ted by di rect 
remedial approaches. In this respect, 
rehabilitation i nte^venti on takes 
the form of helping the client maximize 
vocationally relevant strengths by 
correlating neuropsychological findings 
with specific jobs in which the learning 
di sabled cl ient 1 s residual functional 
capacities will be of most utility 
and in whi ch the f uncti onal areas 



of 1 earning disabilities mediated 
by neuropsychol ogi cal ly 1 i mi ting 
substrates will be least required 
for successful job performance. 

The Intelligence - Learning 
Disability Interaction 

Although by mandate the diagnosis 
of learning disabilities de pends 
on a di sere pan cy between measured 
ability (IQ) and academic achievement 
(reading or count i ng grade level ) , 
the absolute level of mental ability 
of individuals with learning disabilities 
is an extremely important consideration 
in the devel opment of a real istic 
vocational plan for a learning disabled 
client. An individual with an IQ 
of 140, for example, with a significant 
learning disability involving counting 
and mathematical skills (dyscalcul ia) , 
may still have counting and mathematical 
skills at approximately the average 
level : with an IQ of 140, computational 
skills at a level appropriate to 
an IQ of 100 repr ant a significant 
discrepancy, but .<ot one which is 
all that vocationally limiting for 
most work. Conversely, an individual 
with IQ and computational skill appro- 
priate to IQ 60 has the same absolute 
magnitude of discrepancy between 
abil ity and achievement, but would 
be 1 imited to jobs not requiring 
computational skills much above the 
third grade 1 evel . 

In this respect, there is need 
to evaluate the specific vocationally 
limiting features of the learning 
di sabil ity in 1 ight of the gl obal 
1 evel of mental f uncti on in order 
to generate an initial overview of 
vocationally feasible goals. Next, 
the levels of mental function mediated 
by each cerebral hemi sphere can be 
evaluated (by comparing verbal with 
performance IQ on the Wechsler scale). 
Finally, the impact of the specific 
learning d i sa bi 1 i ty , in the co ntext 
of of global and specific Intel lcctural 
strengths and weaknesses; can be 
incorporated into a profile to compare 
with job requirements from the Dictionary 
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of Occupational Titles and other relevant 
sources. Although not necessarily 
so, there is usually a fairly close 
congruence between depressed IQ scores 
on verbal (or nonverbal) scales, and 
specific learning disabil ities involving 
language (or spatial) abilities* 
This occurs because, although learning 
di sabil ity is diagnosed on the basis 
of a discrepancy between ability and 
skill , the underlying neuropsychological 
substrates of verbal IQ tend also 
to subserve language abilities, so 
that a learning disability involving 
1 anguage comprehension wil 1 commonly 
be found in a i ndi vi dual who also 
has comparatively poor performance 
on such Wechsler verbal subscales 
as comprehension , information, simi- 
larities, or vocabulary. In a similar 
fashion, a learning disability charact- 
erized by poor spatial ability or 
poor eye - hand coordination will 
typically be reflected in comparatively 
poor performance on Wechsler subscales 
like block design and object assembly. 



Specific Learning Disabilities 
and Vocational Planning 

Learni ng disabilities involving 
language, the dysphasias (usually 
involving the left cerebral hemisphere), 
can include receptive (typically portions 
of the middle temporal lobe, the arcuate 
fasciculus, Wernicke's areas) , expressive 
(typically anterior portions of the 
cerebral hemisphere, especially Broca's 
area), or both modalities. A special 
type of language disorder, dyslexia 
(usually associated with the angular 
gyrus area of the left parietal lobe), 
refers to a condition in which reading 
uniquely impaired, although there 
need not be any impairment in comprehending 
spoken 1 anguage . The academic correl ates 
of these specific impairments, even 
when they occur in isolation, often 
go well beyond what might be attributable 
to the isolated learning disability. 
The individual with chronic reading 
disabil ity will typically have difficulty 
with most school subjects which have 



test questions or homework assignments 
requiring reading, and will not uncormionly 
fall progressively farther behind 
in general fund of information, vocabu- 
lary, and other areas which normally 
depend on reading for normal mental 
progress. Such a learning disability, 
while educationally very handicapping, 
need not present too formidable a 
barrier to vocational habil i tation, 
provided the individual possesses 
other work rel ated abil ities which 
can be applied to job titles wherein 
reading sophistication is not required. 
For such an individual , relating 
actual reading skill to the G.E.D. re- 
quirements of given jobs can normally 
identify a fairly wide range of vocational 
options, at least in the lower skill 
level job families. It is at this 
point that neuropsychological assessment 
can play a most useful role, since 
such assessment can fairly readily 
identi ty the specific (dyslexic) 
component of more widespread prior 
school difficul ties . For individual s 
with more pervasive dysphasic problems 
involving both receptive and expressive 
1 anguage processing disabil ities , 
planning needs to take into account 
both training and placement consider- 
ations. Training for such individuals 
generally needs to focus on the more 
intact vi sual -spatial modal ities , 
where pictorial representation, "hands-on" 
training, and repetition will be 
more effective than lecturing or 
similar approaches to instruction. 
With respect to job placement, such 
individuals tend to have better long 
term vocational prognoses in jobs 
where their comparatively strong 
visual -spatial skill s can be brought 
to bear. 

Individuals with dyspraxias 
(If dyspraxias involve executory 
probl ems , this more 1 ikely involves 
posteri or ri ght parietal areas , eg. 
Brodmann area 18), reflected in 
poor eye - hand coordination or spatial 
problems, profit from job preparation 
wherein instruction focuses on language 
based sequential instruction emphasizing 
the "why", rather than reliance on 
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more visual aids: for such individuals 
one picture is usually NOT worth ten 
thousand words! Placement can focus 
on work families wherein relatively 
better language skills can be the 
mainstay of successful job performance, 
and jobs where fine visualmoter perfor- 
mance is required can 1 il *wise be 
avoided. Depending on the individual's 
mental abil i ty , and the range of education 
feasi bl e , i ndi vi dual s with 1 anguage 
based learning disabilities but compar- 
atively good right cerebral hemisphere 
medicated abilities are more likely 
to do best in jobs utilizing strengths, 
such as assembler, inspector, tool 
and die maker, skilled trades, drafting, 
engi neeri ng , and , if the individual 
is quite bright, specialized fields 
like surgery. 5- or the individual 
with better language skills and learning 
di sabil ities involving visual -spatial 
abilities, jobs like sales, clerking, 
technical writing, teaching, and if 
the individual is quite bright, psychiatry, 
represent jobs wherein comparative 
strengths can be brought to bear on 
meeting work requirements. 

The focus on comparative strcpqths 
may well be the hallmark of successful 
rehabilitation or habitation planning 
for individuals with learning disabil- 
ities. A learning disability which 
has not responded to twelve years 
of educators' attempts at remediation 
is not a good candidate for a "quick 
fix" by some job training program 
aimed at overcoming a chronic skill 
deficit based on underlying neurological 
dysfunction. Rather, by focusing 
attention on those things the client 
does wel 1 , building on each person's 
unique set of aptitudes and strengths, 
as revealed by careful neuropsychological 
assessment , can the cl ient's job potential 
be maximized in such a way as to help 
him or her best match his or her own 
vocationally relevant assets to the 
world of work. 
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VOCATIONAL ASSESSMENT OF SPECIAL POPU- 
LATIONS: VOCATIONAL ASSESSMENT OF 
DEAF AND HEARING IMPAIRED PERSONS 



KERMIT G. COTTER 



ABSTRACT: Vocational assessment of 
deaf and hearing impaired individuals 
offers vocational evaluators a number 
of challenging problems. This paper 
examines general characteristics of 
deaf and hearing impaired persons, 
problems associated with the vocational 
assessment of these persons, methods 
and procedures which can be effectively 
used in accomplishing the assessment, 
and preparation by staff needed to 
accomplish an effective vocational 
assessment of the population. 

Deaf and hearing impaired persons, 
while being a somewhat diverse group, 
share common characteristics such 
as the cl ient's inabil ity to communicate, 
the client's lack of understanding 
of the purpose of vocational assessment, 
less than full participation by the 
deaf client in assessment tasks, and 
limitations of assessment instrumentation. 
An indepth review of the procedure 
and methods used by the evaluation 
unit at the E. H. Gentry Technical 
Facility of the Alabama Institute 
for the Deaf and Blind is presented 
as a structure for assessment that 
has proven effective with a variety 
of deaf and hearing impaired persons. 
The importance of planning and advanced 
preparation by the evaluation staff 
in the assessment of deaf and hearing 
impaired persons is discussed in terms 
of communication abil ity, proper referral 
information and its review, program 
orientation and cl ient initial interviews. 



The vocational evaluation of 
the deaf and hearing impaired individual 
offers unique and challenging problems 
to a vocational evaluator. Because 
of the nature of the disability and 
i ts associated 1 anguage acquisition 
problems, the evaluator is immediately 
confronted with the problem of communi- 
cation. It is likely that the deaf 
or hearing Impaired person may have 
difficulty understanding what evaluation 
is and why it is important. He may 
have di f f i cul ty in understand!" ng 
instructions, the reasons for assigned 
tasks, and the relationships between 
tisks assigned and real work situations. 

Deaf rehabilitation clients 
ha/e been described as falling within 
three broad categories across a continuum 
form 1 ower f unctioni ng to hi gher 
functioning (Watson, Anderson, Marut, 
Ouel 1 ette , and Ford , 1983) . Lower 
f unctioni ng cl i ents are descri bed 
as severely disabled and/or multi- 
handicapped, generally with limited 
social, academic and vocational skills 
and fall at one end of the continuum. 
The opposite end of the continuum 
represents higher functioning individuals 
who are capabl e of post secondary 
and academic skill s are better developed 
than the lower functioning group 
but who have not attained the levels 
represented by the higher functioning 
group. Thi s descri pti on provi des 
a very general framework for viewing 
deaf cl ients as a group; however, 
when viewed as i n dividual s within 
the group, placement i nto a category 
is not so easy. Many i ndi vi dual 
cl ients possess characteristics from 
two or more groups. It is sometimes 
helpful to speak of groups in gener- 
al i t i es ; however , one must agree 
with Gary Austin's (1983) statement 
that each person is an i ndi vi dual 
and must be treated with a respect 
for that individualism if we intervene 
in their 1 i ves. Eval uators then , 
must plan evaluations on an individual 
basis, using procedures that best 
fit that i ndi vi dual . Vocational 
evaluation of a deaf client begins 
before he physically enters a center. 



A considerable amount of planning 
and staff preparation is necessary 
in order to formulate an evaluation 
plan for the individual. It is not 
possible to overemphasize the importance 
of good referral data and staff communi- 
cation ability. Both are of paramount 
importance to effectively serving 
this client population and obtaining 
suitable outcomes. 

C ommun i cati on in necessary to 
the evaluation process and must be 
effected if valid assessment is to 
achieved (Watson , 1976) . Accepting 
this premise, the ability to use sign 
language effectively is a prerequisite 
for any evaluator who works with deaf 
individuals. This goes beyond the 
mere ability of the evaluator to sign 
English words or phrases and to finger- 
spell . Deaf cl ients arrive for eval uation 
with varying degress of sign language 
ability and must be dealt with on 
their respective levels. More often 
than not, the client uses some level 
of American Sign Language, often accom- 
panied by many "homemade 11 signs and 
gestures. The evaluator must be skilled 
enough with sign language to effectively 
communicate on the client's level. 
This skill is not easy to develop, 
and without constant use, is even 
harder to maintain. The basics of 
sign language expression are easy 
to learn; however, a considerable 
amount of experience with a variety 
of deaf individuals is necessary to 
develop proficient expressive and 
receptive communication .skills and 
frequent exposure is necessary to 
maintain these skills. The evaluator 
who has contact with only an occasional 
dea f person will find it di ff i cul t 
to develop and maintain good manual 
communication skills. In this situation, 
it is advisable to use a qualified 
interpreter to aid in the evaluation. 

It is di f f i cul t to 1 ocate and 
employ a qualified vocational evaluator 
who has good manual communication 
skills; thus, most evaluation center 
will find it necessary to train evaluators 
in the use of manual communications. 
In centers with a large population 



of deaf and hearing impaired individuals, 
the attai nment of a speci f ic 1 evel 
of competence in manual communication 
within a reasonable time frame should 
be a condition of employment for 
all staff. This can be accomplished 
by requ i ri ng i ndi vi dual i n- service 
courses in manual communication and 
gi vi ng the eval uator the opportunity 
to work directly with deaf clients 
under the supervision of a skilled 
peer. Since communication is basic 
to the acquisition of accurate eval uation 
data , and t hi s data i s a fundamental 
part of the rehabilitation plan develop- 
ment, it is imperative that the communi- 
cations link between the deaf cl ient 
and the evaluator be established. 

Al so of substanti al importance 
in ef f ecti ve service del i very to 
deaf cl ients is the advance review 
of good referral information and 
the uti 1 i zation of this information 
in formulating an individual 's evaluation 
plan. Watson recommends the following 
elements of biographical referral 
data: personal data, medical information, 
ophthalmol ogical and optometric infor- 
mation, audi ol ogical and otol ogical 
i nformation , educational i nformation, 
communication skills and narrative 
information (Watson, 1976). To this 
1 ist should be added previous employment 
i nf ormati on . To the eval uator who 
i s experienced in worki ng with deaf 
clients, this i n f o rma t i o n begins 
to give him a picture of the client's 
past experiences and hel ps him to 
be gi n to devi se an eval uation pi an , 
tentatively select instruments, and 
list poi nts to be clarified later. 
This gives the client and evaluator 
common ground on which to begi n an 
evaluation program. It is the respon- 
sibility of the eval uator to make 
the re ha bi 1 i tati on counsel or aware 
of the importance of the information 
requested and to demonstrate i ts 
importance by using it to the advantage 
of the cl ient and counsel or. Counsel ors 
are more inclined to make extra effort 
to su ppl y substantial referral data 
when tangible evidence of its use 
is demonstrated. 
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Another element of planning that 
makes a contribution to effective 
service delivery is extensive client 
orientation, not only to the physical 
plant and services, but more important, 
to the reasons for his being at the 
center. Clients often arrive at a 
rehabilitation center with a variety 
of conceptions regarding why they 
are attending. For many, it is the 
first time away from home. Explanations 
of reasons for rules and regulations, 
answers to the client's individual 
concerns, given by a person who is 
skilled in communication , can hel p 
to insure understanding on his part 
and facilitate his full participation. 
The evaluator gains benefit from obser- 
vations made by the person conducting 
client orientation. Significant obser- 
vations regarding communication levels, 
social interaction, and adaptability 
to new situations can be made at this 
time. 

In the evaluation department 
at the E.H. Gentry Technical Facility 
of Alabama Institute for the Deaf 
and Blind, evaluations were performed 
on a total of 117 deaf clients between 
January, 1983, and July, 1984. Of 
this group, 76 were high school students 
who attended the Alabama School for 
the Deaf, and 41 were regular Vocational 
Rehabilitation clients. During this 
time period, the typical deaf client 
was a male, 20 years of age, who had 
compl eted 9 1/2 years of formal education. 
He had a measured I.Q. of 90, performed 
math operations at the 5.0 grade level 
and had a vocabulary grade level of 
4.2 with a comprehension level of 
4.4. He had minimal (less than 1 
year) work experience in a laborers 
job. 

New clients enter the Gentry 
facil ity once each month. Each evaluator 
is assigned a case load of incoming 
clients and reviews all available 
case referral information on his clients. 
From this information, a tentative 
evaluation plan is conceived, and 
a list of questions to be covered 
in the initial interview is prepared. 



When the client arrives, he 
is gi ven a thorough orientation to 
the facility and a brief tour of 
the city. Orientation also includes 
interviews with medical personnel , 
dormitory staff, social services 
staff. The orientation phase lasts 
two full days and is supervised by 
the client's case manager who, in 
the case of deaf clients, is a person 
highly skilled manual communication. 
A part of orientation is a visit 
to the evaluation unit were the client 
has an opportunity to meet his evaluator. 

The initial interview with the 
client is extensive and serves a 
number of purposes. The client's 
mode of communication is established, 
and observations of communi cation 
competence begin. Rapport is established 
with the new client, and a thorough 
explanation of the evaluation program 
is presented to him. It is in this 
session the^t the evaluator begins 
to determine the client's communication 
level . The eval uator also el icits 
information to clarify any questions 
generated by the referral information 
and attempts to ascertain other infor- 
mation that may have been omitted. 
Whenever permitted by the client's 
1 evel of communication, he expl ains 
the ref err i ng counsel or s questions 
in order to make clear to the new 
client why he is being evaluated. 
In cases where the communication 
level is so low that meaningful expla- 
nations are not possible, the interview 
may consist of the client and evaluator 
touring the evaluation unit in a 
thorough orientation to work stations 
in order to help the client gain 
some knowledge of what to expect. 
In all cases, an attempt is made 
to el icit information regarding the 
client's interests and future goals. 
This serves as a springboard for 
placing the evaluation plan into 
operation. 

Evaluation tasks used with deaf 
clients at the Gentry Facility not 
only produce hard data related to 
specific skills, but also give the 
evaluator ample opportunity to observe 
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the client firsthand in the testing 
situation. This observation is critically 
important since it provides key infor- 
mation regarding work habits and job 
readiness. Factors such as persis- 
tence, time economy, appropriate social 
interactions, reaction to criticism 
and to praise, and the degree to which 
direct supervision is needed are readily 
apparent. It is important to the 
acquisition of accurate data to determine 
1 f a deaf cl ient is parti ci pa ting 
to his fullest on the tasks. Close 
observation provides clues to help 
the evaluator make this determination'. 
It is important that the evaluator 
maintain good rapport with the client 
and offer continued encouragement 
and explanation of tasks to insure 
the client's full participation. 
It has been our experience that the 
majority of deaf cl ients respond positively 
to this extra personal attention. 

Whenever possible, the evaluation 
begins with academic testing. Reading 
vocabulary and reading comprehension 
are measured by the Gates-MacGini tie 
Reading Test, Level E, Form I. This 
test provides norm groups for comparison 
from fourth grade through twelfth 
grade completion. Since our clients 
are to be competing for employment 
with the general population, it yields 
more accurate information to compare 
them with general population norms. 
The Level II math portion of the Wide 
Range Achievement Test is the instrument 
of choice when measuring ability in 
arithmetic. On occasion, it is of 
advantage to use the Level II reading 
portion of the WRAT with persons of 
very low reading ability in order 
to obtain some measure of functioning 
below the level measured by the Gates— 
HacGinitie. 

Intellectual assessment is accom- 
plished through individual testing 
using the Performance section of the 
Wechsl er Adul t Intel 1 i gence Scale- 
Revised. On occasion, when the client's 
interests indicate college training, 
the Verbal Section is also administered. 
When college training is in question, 
we agree with Falberg (1983) that, 
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without assessment of the deaf client's 
current verbal f uncti oning skil 1 s , 
insufficient data is available upon 
which to base a prediction. Another 
instrument often used is the Raven 
Standard Progressive Matrices. 

Because often a deaf person' s 
store of vocational kn owl edge is 
limited, interest testing is important. 
If the cl ient 1 s reading 1 evel is 
sufficient, the Kuder General Interest 
Survey i s used . For 1 ower 1 anguage 
level clients, the Geist Picture 
Interest Inventory (REV.) is admini- 
stered. Occasional 1 anguage inter pre- 
tati on is necessary on both tests . 
This is permissible since the objective 
is to measure interests , not reading 
skills. Interpretation of the results 
is important for either test. Since 
interest inventories are essentially 
sel f-report instruments, the client 
is the final judge of the validity 
of the results. 

The assessment of independent 
living skills is a critical factor. 
A client may have solid aptitudes 
and potential for scores of jobs; 
however, his chances for maintaining 
successful employment are often dependent 
on his ability to live independently. 
It is the policy of our facility 
to assess the person's skills in 
the critical phases of i ndependent 
living and recommend remediation 
of weaknesses either prior to or 
in conjunction with vocational training. 
Phases assessed are money management, 
occupational adequacy (work habits, 
job acquisition skills), family life, 
community living, health and safety, 
communications , transportation, personal 
and home management. Assessment 
is through a variety of measures 
incl uding direct observation, evaluator— 
developed tasks and tests, formal 
measures such as the Street Survival 
Ski 1 1 s Questi onnai re and Val par Uni t 
#17, and by direct one to one questioning 
of the client, using questions phrased 
in such a way that the client must 
demonstrate basic knowledge in his 
answers . 
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Standardized dexterity testing 
is accomplished through the use of 
the Pennsylvania Bimanual Work Sample, 
the Crawford Small Parts Dexterity 
Test, and the Purdue Pegboard. All 
of these instruments can easily be 
explained or demonstrated and provide 
a measure of manual and finger dexterity. 
These often are viewed by the clients 
as competitive, thus insuring full 
participation. 

As a measure of a person's ability 
to work in a purely physical task 
requiring prolonged standing and rapid 
manipulation of objects and as a measure 
of physical stamina to maintain pace, 
the evaluation unit at E.H. Gentry 
employs one or more of a group of 
work sampl es devel oped by National 
Industries for the Blind research. 
While these samples were originally 
developed for blind clients, only 
slight modification gives them general 
application to most kinds of cases, 
and they have proven beneficial with 
deaf clients. Two of the samples 
are termed electro-mechanical and 
employ a work pace-timer developed 
to give the client instant feedback 
when he slows his pace. Another is 
an assembly task in which the client 
is required to use both hands to complete 
two assemblies simultaneously. All 
these work samples require prolonged 
standing and rapid, accurate hand 
and arm movement. Performance is 
measured against a production standard 
based on average sighted workers. 

Aptitude identification is a 
key factor in vocational evaluation 
and receives considerable attention 
in our unit. The Dictionary of Occu- 
pational Titles identifies eleven 
critical aptitudes and uses these, 
along with other factors, to construct 
job prof il es . Aptitude identification 
is accomplished at Gentry through 
the use of several instruments. The 
General Aptitude Test Battery is employed 
in all cases except extremely 1 ow 
functioning deaf clients and we have 
experienced very good success with 
its use. It provides an excellent 



vocational counseling tool and basis 
for occupational exploration. 

An additional aid in identifying 
aptitudes is found in the more global 
components of the Valpar Component 
Work Sample Series. These units, 
used wi th video-taped instructions , 
have problem popular with the deaf 
clients at Gentry and have provided 
very useful data . A wi de vari ety 
of norm groups. Performance on individual 
component units can be related to 
a variety of existing occupations 
and provides more supportive information 
for vocational counseling. 

Once information regarding all 
factors outl ined has been gathered 
and organized, a frank discussion 
of the cl ient 1 s strengths and weaknesses 
form the basis for program recommen- 
dations. It is occasionally necessary 
to al 1 ow the cl ient a trial period 
in a vocational traini ng area . More 
often, the client has made a decision 
and is ready to make a commitment 
to a program of training or adjustment 
that will enable him to advance. 

To determi ne the effectiveness 
of the eval uation program at E.H. Gentry, 
the same group of deaf cl ients previously 
mentioned was selected for study. 
Since most of the high school students 
returned to school , no data was available 
for comparison with this group. 
For this reason, only the full-time 
re ha bil i tat ion cl ients were sel ected 
for study. Evaluation findings and 
recommendations were compared 
the actual trai ni ng programs sel ected 
by the cl ients who had experienced 
the evaluation procedures as outlined. 
The criteria used was successful 
program completion or average progress 
rati ngs on monthly progress reports. 
Of the group who did not compl ete 
training or adjustment , approximately 
50% sel f- terminated for reasons other 
than traini ng rel a ted , and the other 
50% were facility terminated for 
di sci pi i nary reasons . The study 
group was comprised of 41 persons, 
28 males and 13 females. Ages ranged 
from 16 years to 47 years with an 
average age of 24 years . Fifteen 
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percent of the group were multi-handi- 
capped. Aside from the average age, 
there was no appreciable difference 
between the group of 41 and the total 
group described earlier. 

Of the study group, 10% chose 
to leave the facility program after 
evaluation, and information is not 
available regarding the outcome of 
evaluation. An additional 5% left 
the facility program; however, follow-up 
information was available. They were 
counted within the group who entered 
vocational training. Fifty-four percent 
of the group was referred for vocational 
training and entered training in the 
recommended area or in a closely related 
area based on evaluation information. 
While the majority entered training 
at E.H. Gentry Technical Facility, 
four other trade schools, technical 
colleges or junior colleges were chosen. 
Thirty-six percent were referred full 
time to the Rehabilitation Center 
section of E.H. Gentry for remediation 
of deficit? in independent living 
skills or for work adjustment problems. 

Of the group who was referred 
for vocational l.aining, 28% have 
successfully completed the training, 
and 36% actively being trained. The 
remaining 36% terminated during training. 

Of the group who were referred 
to the Rehabilitation Center, 36% 
have completed adjustment programs 
and have moved into vocational training 
or employment, or are actively seeking 
employment. Twenty-eight percent 
of the group remains in adjustment 
or independent living skills training. 
Coincidentally, the same percentage 
(36) of persons terminated as in the 
vocational training group. 

Because the adjustment services 
figure only refl ects the accuracy 
of identified adjustment needs and 
not the accuracy of the entire evaluation 
i nsuf f i cient fol 1 ow-up information 
after adjustment is available to test 
the accuracy of vocational recommendations 
with this group, follow-up will continue. 
Of the group who was referred for 
vocational training, it has been determined 
from training progress reports that 
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evaluation findings and recommendations 
were accurate in 86% of the cases. 
We think that his represents an excellent 
success rate. 

In summary, we at the E. H. Gentry 
Technical Facility believe that there 
are several key factors in constructing 
a vocational evaluation unit which 
can effectively service deaf clients. 
First, and most important , is the 
ability to communicate with the client 
on his level. This is not only basic 
to the eval uation process , but is 
an absolute necessity in order to 
provide the feedback and day-to-day 
counseling necessary to maintain 
the cl ient 1 s participation. Pre-planning 
and a good orientation to the facility 
is necessary to get the client started 
in a positive frame of mind. Rapport 
between cl ient and evaluator is absolutely 
essential with deaf clients, and 
the client should be provided with 
explanations and feedback on a continual 
basis to maintain his interest and 
assure his participation. A wide 
variety of good instrumentation is 
necessary for use with many levels 
of deaf and hearing impaired clients. 
Wi th these factors i n pi ace and con- 
sci enti ousl y applied, successful 
evaluations can be performed with 
deaf persons with consistency. We 
consider the eval uation program at 
E.H. Gentry to be a successful program 
as demonstrated by the study quoted 
in this paper; and we take pride 
in the belief that we are making 
a worthwhile contribution to the 
rehabilitation of deaf individuals. 
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